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hincar  probler.'r.  of  centra]  interest  in  luiiucrical  analysis  arc  tlic  solution 
of  linear  equations,  Uie  const  rvicti on  of  tlie  inverse  or  a generalir.ed  invei  s.e  of  a 
linear  opor.itor,  finding  tlie  eigenvalues  and  eigenvectors  of  a linear  operator,  and 
linear  piqgrai.jtii  ng.  A survey  is  riade  of  nu!t)!ods  \-''nich  apply  if  t)ic  data  of  a solved 
linimr  inoblon  is  perlur’ned  by  oi'Ciators  and  vectors  of  small  norm  (analytic  pertui- 
batif)n)  , or  by  operators  of  finite  ran);  and  vectors  belonging  to  a f inite-diir.ensional 
niOjspace  (algebraic  pci  t >ii bation)  . Ferturbation  methods  may  be  used  to  extend  t!ie 
tlieory  of  linear  problems,  to  estimate  errors  due  to  inaccurate  d;ita  and  computation, 
and  to  solve  ]>erturbed  problcr.is  with  economy  of  effort. 

1.  I. i near  prcblera.  In  the  abstract  fiamework  of  functional  analysis,  a linear 
problem  is  one  vdiicli  can  bo  for  invil  ated  in  terms  of  linear  spaces  and  operators  (38  , 
Cliapter  1].  tiaturnlly,  many  )m  cOilcnvs  of  theoretical  and  practical  interest  in  numer- 
ical analyr.ii;  Irelong  to  tliis  general  class.  Among  those  jirobl em.s , some  are  important 
enough  to  be  tlio  subjects  of  extensive  investigations,  and  also  t'lppc.'ir  in  t.bc  daily 
wor);load  of  most  coniniting  centor.s  devoted  to  genera)  scientific  corr-jputation . Of 
those  significant  problems,  the  ones  singled  out  for  discussion  here  ari.:  (a)  solu- 

tion C)f  linear  equations,  (b)  inversion  of  linear  operators,  (c)  finding  the  eigcri- 
cigenvalues  and  eigenvectors  of  a linear  operator,  and  (d)  linear  programming.  These 
problem:;  will  now  be  defined  in  approjiriatc  generality. 

F-olution  of  linear  cqviations. 

l,et  X,y  don’ot-C  complete  nonned  linear  spaces  over  a common  scalar  field  A.  In 
most  applications,  one  has  A = R,  the  real  nuirsbers,  or  h ~ C,  the  complex  num- 
bers. Tlic  notation  b(X,Y)  will  bo  \iscd  for  the  set  of  continuous  linear  operators 
from  X into  Y . Given  an  operator  A c L(X,Y)  and  a vector  y c Y as  data,  the 
problem  is  to  find  a solution  x c X of  the  linear  equation 

(1.1)  Ax  = y . 

For  practical  as  well  as  abstract  treatment  of  this  problem,  it  is  important  to 
be  in  posso.ssion  of  a theory  of  equation  (1.1),  which  provides  inform.ntion  as  to 
which  of  tlie  following  alternatives  holds; 

llx>nsorcd  by  Die  United  States  Army  undej-  Contract  No.  ; n.AAGDO-VS-f^-OO.l-l . 
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(i) 

For  each 

y C Y, 

(ii) 

for  some 

y C Y, 

solutions. 

or 


Tlic  choice  between  (i)  cxislence  nnd  vmiqucnor.r.  or  (ii)  iioneNi stcncc  or  nonuniqiie- 
ners  or  siolutionE  cxJmvists  the  logical  possibilities,  nnei  thus  tlic  .il  (t'ln.tt  Jvo  :lriic- 
tvro  (1.1a)  will  bo  characteristic  of  Die  tlicory  of  any  equation,  linear  or  noiil  i i^ear . 
In  case  (i),  the  operator  A is  said  to  be  iionsf ngular ; otherwise  (case  (ii)),  it 
is  called  a singular  oj->crator. 
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X = A y 


A ^ satisfies 


a“^a  •■=  AA“^  - 1 


^ vers  ion  of  _1  i jie  a r opeiators. 

This  problem  is  closely  related  to  tlio  solution  of  linear  equations.  In  the 
)ionsi ngvil ar  case  (i)  , equation  (1.1)  defines  tlie  linear  (right)  inve-rse-  operator  h 
which  gives  the  unique  solution  x as 
(1.2) 

In  jn:uiy  applications,  one  has  V = X and 

O . 3) 

v/here  I denotes  the  identify  operafor  in  X , that  is,  Tx  - x for  all  xc  X. 

In  the  singular  case  (ii),  the  cil  t ernat  ives  are  nonexistence  or  nonimiqueness 

of  noliitions  x of  (1.1).  T’ne  inverse  op>erator  A ^ of  A dvoos  not  e.xist  in  tliis 

case,  but  one  may  sceh  a generalized  inverse  A^  of  A vdiich  has  some  propcutics 

which  are  desirable  for  the  application  at  hand.  For  example,  in  connection  with  tlv 

problem  of  solving  the  linciir  equation  (1.1),  one  might  want 

+ 

(1.4)  X = A y 

to  be  a .solution  if  the  equation  is  censi  stent , and  tJius  is  satisfied  by  one  or 
more  elements  of  X.  It  tuins  out  that  this  is  equivalent  to  the  condition  that  a"^ 
satisfies  the  operator  equation 

A. 

Any  c>i>eiator  A'  for  which  (1)  holds  will  bo  called  an  inner  inverse  of  A (.15,  pp. 
7-11).  Tlic  more  formal  tcjm  {l)-invorse  of  A [3,  pp.  7-8)  has  also  been  applied 
specifically  to  operators  A^  satisfying  condition  (1). 

If  equation  (1.1)  is  consistent  and  A^  is  an  inner  inver.se  of  A , then  all 
soluVir>ns  x may  be  represented  in  the  form 

(1.5)  X ■=  A y + (I  - a'a)z 

for  z c X.  Witli  2 arhitjary,  formula  (1..5)  is  called  tlie  general  solution  of 
equation  (1.1),  ns  in  t)io  elomontar'y  t)icory  of  linear  dif feronti.al  equations. 


(1) 

.t 


AA^A 


. General i;'.c  1.1  invokes  r.iay  alr.o  be  xir.oful  in  ease  equation  (1.1)  has  no  r.olvil ion;., 
and  thus  is  said  to  be  inconr.istant,  or  ovcnlctct  wineJ . Here,  the  ixosnibility  of 
choosing  a general i::cd  solution  x to  ininiini;;c  the  noiia  of  the  residual  vector 
(l.G)  r = Ax  - y 

in  y is  considered,  f^uppose  that  the  set 

(1.7)  G(A,y)  = {x  1 II  Ax-y||  = min  I|Az-y||  } 

zcX 

of  generalized  solutions  x is  nonempty,  ns  will  certainly  be  the  case  if  ev;]u.ition 

(1.1)  is  consistent.  If  Y is  a Hilbert  space,  then  elements  x c G(A,y)  are  ordi 

narily  called  least-squares  solutions  of  the  linear  equation  (1.1).  Tims,  one 
might  require  that  A%'  e G(A,y)  for  all  y C Y in  addition  to  property  (1).  Fur- 
theiTxvore,  the  subset 

(l.b)  S(A,y)  - {x  I X C G(A,y),  ||  x ||  = min  ||  z ||  } 

zeG(A,y) 

of  G(A,y)  may  be  nonempty,  and  would  then  conri.st  of  the  generalized  (o)-  Ic.art- 

squarcs)  solvitions  x of  (1.1)  c>f  minimum  noj  in.  The  requiieinent  that  A^y  c S(A,y 

for  all  y c y would  then  also  be  a ix:;ssible  additional  restriction  on  t.he  set  of 

generalized  inverses  of  A . If  5:(A,y)  consists  of  a single  point  for  each  y c V 

tlicn  the  corresponding  generalized  inverse  A^  is  uniquely  deterzo nod . In  c.^se  X 

t 

and  Y are  finite-dimensional  I'.ucl vde.in  spaces,  this  generalized  inverse  A cxir' 
and  i.s  the  MnoTC-l'enrose  inverse  of  A (3,  pp.  7,  103-1  i>l),  which,  in  addition  to 
(1).  satisfies  the  condition 

1 t 1 

(2)  A AA  = A ; 

that  in,  a"^  is  also  an  outer  inverse  of  A (25,  pp.  12-14],  and  the  syinr.etry  con- 
ditions 


(3) 

+ * 

(AA*) 

(4) 

■> 

— 

> 

where  M denotes  the  conjugate  transpose  of  the  matrix  M . 

The  problem  of  finding  generalized  solutions  can  become  delicate  in  more  general 
spaces,  as  the  set  S(A,y)  may  consist  of  more  than  one  element  or  be  empty  (20,25); 
in  fact,  G(A,y)  will  bo  empty  if  the  infimum  of  the  norm  of  the  residual  vector  is 
not  attained.  Of  course,  there  are  also  many  applications  of  generalized  inverses  in 
addition  to  the  solution  of  linear  cqu;>tions  in  the  singular  case  [3,21],  and  this 
fairly  recent  subject  already  lias  a vast  literature  [24]. 


C.  *riiG  oi9cnval\io-c'iqi.'m'cc(:or 

Thin  problem  is  ix)scd  most  naturally  in  the  ease  V = X is  a llilbcit  si’.ici'  wit); 
inner  product  < , > . One  looks  for  scalars  (real  or  cotru^lex  numbers)  A and  vec- 
tors X 5^  0 such  tliat 

(1.9)  Ax  = X X. 

Solutioiif;  X of  t)iis  problem  arc  called  cdgcnwilucr.  of  the  linear  o)'crator  A;  fc; 
cacli  ci<ie!ivalue  X , nonzero  solutiojis  x of  (1.9)  are  said  to  be  the  corrostwidi  nc 
eSgc'in'Cctors  of  A.  As  equation  (1.9)  is  lioi-.Ksgencous  in  x , tlic  condition  a / 0 
may  be  replaced,  for  example,  by 

(1.10)  < x,x  > = 1 , 

or  j.omo  other  t^onnalization  condition. 

From  a standix>int  of  functional  analys.in,  the  detenui nation  of  the  ciejenva  1 ues 
of  A is  a specicil  case  of  the  more  general  problem  of  finding  the  sjK'ctruni  0(A) 
of  A.  In  a complex  Hilbert  space  X , the  set 

(1.11)  p(A)  = {X] (A  - Xl)~^  C L(X,X)  ) 

of  complex  nunbors  X is  called  the  ra;ol\'cnt  of  A . Thus,  X c p(A)  if  and 
only  if  the  oiierator  A - Xl  h^is  a continuous  inverse.  The  spi..ctrum  of  A is  sir- 
ply  tl  ic  complcmont  of  the  resolvent, 

(1.12)  0(A)  •-=  C - p(A)  , 

«uid  hence  contains  any  eigenvalues  of  A . 

d.  Li  near  progranuning. 

In  order  to  formulate  this  problem,  supiose  that  X,Y  are  real  s)races  with 
partial  oi  cloying  relationships  denoted  by  < . For  most  applications,  X and  Y 
arc  taken  to  )re  f inr.tc-diinenrional , in  which  case  the  partial  ordering  is  the  i;rual 

componentwise  comp.arison  of  vectors  [2G,  pp.  155-198).  Also  needed  is  the  diuil 

* 

s'/'.rre  X = L(X,K)  of  X;  that  is,  the  space  of  continuous  linear  func^tionals  de- 
fined on  X . It  is  convenient  to  use  the  bracket  notation  of  Dirac  (7,  pp.  lS-2Pj 

* 

for  linear  functionals.  If  c c X , then  define 

(1.13)  < c,x  > ;=  c(x)  , 

w)iich  will  be  consistent  with  the  notation  for  the  inner  product  if  X is  a Hilbert 
Bjxrce  IV,  pp.  6-0). 

One  fonnulntion  of  t)ie  (prin'al)  linear  prograrming  problem  (26,  pp.  156-157) 

* 

is,  given  A c L(X,Y),  y C Y,  c C X , find  x c X to  maximize 

(1.14)  f(x)  = < c,x  > + C 
subject  to 

(1.15)  Ax  < y , X > 0 . 
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Tho  funct  ion  f (x)  defined  by  (1.14)  is  called  the  objoctivc  function  of  t.lie  jnob- 
Icm,  and  conditions  (1.15)  are  known  as  com-ti.iints.  ' 

Instead  of  the  jirirvil  problem  (1 . 14)  - (1 . 15)  , one  may  wis)i  to  consider  t)io  dii.iJ 

* 

pro}>.lom  [2G,  pp.  lPa-190)  which  is  to  find  2 c Y to  minimize 
(1.36)  g(z)  = <z»y  > - C 

subject  to 

(1.17)  • A z ^ c , z ^ 0 . 

* * « 

In  (1.17),  tlic  operator  A e L(Y  ,X  ) is  tlie  ndjoint  of  A , defined  l>y 

(I.IB)  <A  y ,x>  = < y ,Ax  > 

* * 

for  all  y c Y , x c X . It  will  also  be  convenient  to  write 

* * * * * 

(1 . 19)  yA:=Ay,  y gY  ; 

* 

that  is,  y A is  the  linear  functional  on  X defined  by 

r « * 

(1.20)  (y  A)x  :=  y (Ax)  = <y,Ax>,  xcX. 

This  is  analogous  to  the  notation  frequently  used  in  clcMvientary  matrix  algeln'a,  with 

* 

X being  considered  to  bo  a column  vector,  and  y a row  vector.  The  scalar  quan- 
tity (1.20)  w’ill  also  be  denoted  by 

(1.21)  < y*Ax  > :=  < y*,Ax  > . 

The  subject  of  perturbation  methods  and  theoiq'  has  a long  hisl.ory,  and  tlicre  is 
a vast  literature  devoted  to  this  topic  and  its  appl  icat.ioiis.  Tlio  hil'liography  at 
the  end  of  tliis  pai.^ei',  ratlier  than  attempting  to  be  comprehensive,  lists  only  refer- 
ences cited  in  the  text,  doulrtless  at  the  cost  of  omitting  a nuirl.>or  of  significant 
contributions. 


2.  Pert  ui'hcd  1 i n ea  i~  p >'  oh  1 om- . Perturbation  thoojy,  as  applied  to  tlic  linear  prob- 

Icnrs  listed  in  5l,  starts  from  the  assumption  that  their  solutions  are  known  for  tho 

it 

given  reference  data  A c L(X,Y),  y g Y,  c c X . The  object  is  to  sttwly  tho  be- 
havior of  these  solutions  for  various  classes  of  perturbed  data. 

(2.1)  B = A + Aa  , z y + Ay  , d - c -t  Ac  , 

* 

where  tho  perturbations  Aa  g L(X,Y),  Ay  g Y , Ac  g X or  appropriate  informatioji 

about  them  arc  given.  One  tlion  desires  to  calculate  or  estimate  the  corrcsj;x)nding 

changes  Ax  c X,  Aa~^  c L(Y,X),  Aa^  g L(Y,X),  AX  g A in  tho  .solutions  x g X,  A ^ c 
<••  • . * 
l>(y,X),  A e L(Y,X),  X c A of  the  original  problonrs.  Here 

(2.2)  Aa“^  = b”^  - 

denotes'  t)io  difforenco  between  the  inverse,  if  it  exists,  of  tlie  perturbed  operator 
B and  the  inverse  bf  tlie  unperturbed  operator  A , and  not  (fiA)  which  may  also 
exist.  A similar  obsci'vation  applic.s  to  tlic  notation  Aa^ . 
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As  an  example,  the  tviibed  linear  sysVci.^ 

(2.3)  D\x’  « z 
can  lie  solved  for 

(2.4)  w X H Ax 

if  Ax  can  be  obtained  in  tcrinr,  of  Aa  and  Ay,  the  r.olntion  x of  t)ie  unpci'tinbed 
system  (1.1)  with  refcionce  data  A,  y being  a;;r.umod  to  be  known. 

The  motivation  behind  pertnibation  motliod.s  ir.  Dial  if  t)ie  j'oituibations  in  the 
data  are  "r-mall"  in  roiiK?  sense,  then  one  might  cxiicct  the  cliangcr.  in  the  solutions  to 
bo  corresi>ondirig5y  small,  at  least  under  suitable  conditions.  Khat  is  referred  to 
here  as  "small"  may  vary  widely,  depending  on  1 he  specific  problem,  the  type  of  per- 
turoation  considered,  the  computing  jiower  available,  and  pcrh.ajir.  other  factors.  In 
the  next  section,  a framework  will  be  develojied  to  characterize  tlie  concept  of  small 
perturbations  more  precisely. 

The  goals  of  jiorturliat  i on  tlieoiy  may  be  cither  pi  actical  or  theoretical.  Ti\'o 
user,  of  jicrt  virbation  methods  in  nctu<al  computation  are  to  find  solutions  of  portei'bcd 
problem.^  with  economy  of  effort,  and  to  obtain  error  estimates.  In  the  first  case, 
computing  tlic  solution  of  a given  linear  problem  might  be  cxtreiticly  laborious,  but  a 
large  amount  of  i nforira  tion  could  he  generated  in  the  process.  One  would  then  h.opc 
to  be  able  to  use  this  information  to  solve  j)erturbat  ions  of  the  icfercnce  problem 
with  less  work  than  required  when  starting  from  scratch,  as  indicated  in  connection 
with  the  illustration  (2.3)-(2.4)  cited  iibove.  In  tlie  case  of  eiuor  esti;:iation,  the- 
perturbations  are  considered  to  arise  from  inaccuracies  in  the  data  and  from  trunca- 
tion and  roundoff  errors  in  the  computation.  Usually,  these  perturbations  can  only 
be  cstiroted,  and  one  socks  some  kind  of  information  about  the  possible  error  in  the 
solution.  One  approach,  called  foiward  error  ertirnt  Jon , starts  from  assumjitions 
about  the  pc,>rturhations  in  the  datfi,  and  obtains  a comparison  of  the  solution  actual- 
ly obtained  with  that  of  the  reference  problem  if  exact  data  and  compvitation  were 
employed.  For  backward  error  astJr.ution , as  developed  by  Wilkinson  (34)  , the  solu- 
tion actually  obtained  is  taken  to  be  the  exact  solution  of  some  perturbation  of  the 
reference  problem,  ajid  estimates  arc  inade  of  the  cor j'c'SiX>nding  changes  in  the  data. 
Kith  the  foras’ard  method,  the  computed  solution  is  considered  to  be  acceptable  if  it 
can  bo  showni  to  be  "close"  to  the  (unknown)  .solution  of  the  reference  problem,  while 
in  the  bac);ward  procedure,  the  criterion  of  acceptability  is  that  tlie  problem  actvial- 
ly  solved  is  "close"  to  t)io  reference  problem  in  some  sense.  Itore  precise  concepts 
of  "closeness"  will  be  introduced  in  the  next  section. 

Perturbation  mcthod.s  ca)i  also  be  used  for  theoretical  purposes.  If  a concci^tual 
framework  can  bo  developed  in  which  the  problems  considered  can  bo  viewed  as  pcrlur- 
b.ations  of  problcnvs  with  knov.ni  theory,  then  it  may  be  )>ossiblo  to  extend  this  theory 
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from  one  class  to  tJio  other.  Tliis  is  tlie  basis,  for  oxanplc,  of  the  class.ical  ti'ch- 
niqvjo  of  I'l  hard  Sc)imidt  for  obtainiiuj  the  tlu'Oiy  of  linear  Fredliolm  intcyial  equa- 
tions of  second  ),i)id  from  t)ie  tl)cory  of  finite  linear  algebraic  systems  [*1,  p.  ISS). 

A more  general  situation  will  be  described  in  a later  section.  Another  thc'oiet i cal 
vise  of  perturbation  methods,  closely  related  to  error  estimation,  is  to  detennine 
the  se;j.‘;i  ( j Vi  ( y of  the  solution  of  a linear  problem  to  changes  in  the  data.  For 
example,  oiie  may  wish  to  hnow  which  comiKinents  of  the  solution  arc  affected  most 
strongly  by  a small  change  in  one  of  the  coefficients  of  the  iiqiut  data,  and  which 
arc  relatively  undisturbed.  This  kind  of  analysis  can  also  be  used  to  pursue  causc- 
nnd-effect  relationships  in  mathematical  models  of  various  natural  systems  and  pioc- 
esses. 

3.  Aiialy  ti  c and  algebrai  c perturbat  ions . For  the  present  purJ^os^s,  it  will  be  cciii- 
venient  to  clas.'-ify  perturbations  into  two  noncxclu.si ve  categories;  .analytic  .and 
algebraic.  This  classification  arises  from  the  informal  ion  available  in  each  c.ase 
and  the  methodology  used  to  solve  the  pcrtnrbation  problem,  as  well  as  .an  atterpt  to 
clarify  wliat  is  meant  by  a "small"  jicrturbat  ion . In  general,  .analytic  j;c  it  urb.it  ion 
theory  nses  metric  infomintion,  .and  obt  ains  solvit  ions  to  portuib.ition  prob}rT..s  in 
torri-'i  of  series  c.Npansions,  or  by  iterative  laethods.  A.n  objective  critc-’ion  for  a 
jx'rtnrbation  to  be  small  in  this  case  is  that  the  required  series  or  iteration:,  con- 
verge. A more  svibjcctivo  condition  is  th.at  the  convergcmcc  be  raiaic?  enough  to  bo 
useful  in  practice.  The  satisfaction  of  this  restriction  will  depend,  among  otl.or 
things,  on  the  computing  power  .avail.able  and  whether  the  transformations  involv.-d 
can  be  carried  out  explicitly,  or  bavo  to  be  .appro.siri'iit  ed. 

The  idea  of  smallness  for  algebraic  perturbations  also  dc-penJs  more  or  loss  on 
outside  f.actors.  Here,  the  perturbations  of  operators  arc  operators  with  finitL- 
dimension.il  range,  and  vectors  and  functionals  are  perturbed  by  elements  belonging 
to  finite-dimensional  subsxraces  of  the  corresponding  sp.accs.  'Jiic  solution  of  .alge- 
braic perturbation  problems  will  require  solving  finite  algebraic  jnoblcms  of  similar 
type,  with  the  judgment  as  to  what  constitutes  a "small"  finite  algebraic  problem  be- 
ing .again  tied  up  with  the  resources  av.ailablc:  for  comiruting.  For  example,  e.ar  ly 
workers  in  the  tlioory  of  linear  integral  equations  knew  that  replacing  them  by  a cor- 
resj-xanding  finite  linear  algebraic  system  would  yield  good  approxiinatc  solutions, 
but  despaired  of  being  .able  to  solve  systems  of  order  10  or  20,  .as  might  bo  required 
to  attain  the  dosired  accuracy  tlOi  p.  2<12) . By  contrast,  tod.ay  most  computing  cen- 
ters are  able  to  furnish  the  solutions  of  well-conditioned  linear  algebraic  systomr. 
of  order  100  or  200  at  nominal  cost. 
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More  precise  foriiiu]  at  ions  will  now  be  made  of  tlte  tyi>c  of  information  yivt'n  .incl 
cxjxjctcd  with  each  type  of  pertvirbatipn. 

a . Analytic  pc r t ii rba tionr. . 

Tl»c  fundamental  metric  information  about  vectors  in  Panac)i  spaces  X,Y,...  is 
given,  of  course,  by  t)ie  respective  norms  II  Iljj  » II  lly  ' • • • • confusion  is  un- 

likely, the  sul^scripts  will  usually  be  dro]iped.  If  A is  a continuous  linear  oi'er- 
ator  from  . X into  Y , that  is,  if  Ac  HX,Y) , Dien  t)u;  mmibers 

(3.1)  M(A)  = sup  IIaxII  , m(A)  = inf  jj  Axl|, 

llxihl  11x11-^1 

exist  and  are  finite  (2,  p.  54;  1C»,  p.  194)  . 15(A)  and  m(A)  are  called  t)io  upper 

and  Jower  hound  of  A,  rosj cctively . With  the  natural  definitions  of  additio!i  and 
scalar  multiplication  of  linear  oj'erators,  it  is  well  known  [38,  p.  163)  that  h(X,^■ 
is  a Banach  space  for  tlic  operator  norm  ||aH  = M(A).  In  some  spaces,  this  norm  is 
easy  to  eompvite,  but  in  others,  finding  15(A)  n\iglit  rcquiie  more  effort  t)ian  solvin. 
the  proljlcm  of  interest.  For  numerical  pu)'ix>scs,  it  is  often  convenient:  to  assign  a 
nonn  to  tlK!  linear  operator  space  L(X,Y)  wliich  is  easier  to  compute  than  the  oper- 
ator norm,  and  is  consistent  with  it  in  the  sense  that 

(3.2)  ||a||  > M(A)  . 

For  example,  if  X = Y = e”,  (complex)  n-di  mens)  onal  Euclidean  sj'ace,  then  A • 

is  reiuesentcd  by  an  nxn  matrix  wiUi  eigenvalues  ...,1  . Ojie  h.ss 

1 2 n 

(3.3)  M(A)=  max{ ] 1 ,) ),..., 1 A^l } , 

which  requires  finding  the  eigenvalue  of  largest  modv)lus  cjf  A.  On  the  other  liand, 
the  Fuc] idean  norm  of  A , ^ . 

OM  II  Ml-  (I 

i=l  j=l  J 

is  consistent  and  may  be  found  by  a straightforward  calculation. 

ic  it 

In  the  case  of  the  adjoint  spaces  X ,Y  , ...  of  continuous  linear  functionals 
on  X,Y,...,  the  noi-m  will  always  be  defined  iinalogously  to  the  operator  norm,  that 


sup  1 < c,x>  1 

II X 11-1 


for  c c X . 


Thus,  in  the  perturbed  linear  system  (2.3),  one  would  want  a convergent  process 
to  calculate  Ax,  or  an  estimate  for  [jAx  ||  in  terms  of  bounds  for  ||AA  ||  and 

llAyll  , and  perhaps  alfio  the  known)  quantities  ]|  A H , ||  x |1 , |IyH  . 

b.  Algebraic  perturbations. 

An  algebraic  p>erturbation  Ay  of  a vector  y e Y is  defined  to  be  an  element 
of  a finite-dimensional  nubspacc 


(3.6)  . . . ,y^) 

of  y conniGting  of  nil  lino.'u’  combi iiat  i dug  of  given  iiKiopendcnt  basis  vov-tors 

in  Y . A similar  definition  applies  to  algebraic  I'ortnrbat  ions  of 
linear  functionals.  Ojdinarily,  algebraic  )'orturVKitions  will  be  restricted  to  sub- 
spacer.  witli  .small  dimen.sion  (in  tbe  .sense  descril'cd  above).  no>»'Cvcr,  if  tlie  oi'ieinal 
spaces  are  f ini  t e-d  iricns.ional  , it  is  of  course  ixjs.siblc  to  rciu'cscnt  an  aibitraty 
perttnbation  as  an  algeb)-aic  perturbation. 

In  the  ease  of  lineaj-  oj’O)  ^itors,  algebraic  pc-r txnbat i onr.  are  represented  by 
linear  oj'oratorr.  with  fini  tc-dinensional  ranges.  Such  oj'crators  arc  .said  to  bo  of 

finite  rmik,  or  degenerate  (in  i nf  ini  te-di  inenni  onal  spaces).  Here,  the  dy^^iic 

* 

notation  o£  Dirac  17,  pp.  2G-20)  will  be  adopted;  for  u c Y,  v f X , the  symbol 

u Xv  will  rejirc.sent  an  operator  of  rank  one  from  X into  Y , with 

(3.7)  (u><v)x  = u<v,x>=<v,>;>ucy 

* * 

for  X c X.  Also,  for  y c Y , the  tranr.posed  operation  v.-ill  bo  denoted  by 

* « « 

(3.8)  y (u  ><  v)  - < y ,u>  V C X , 

again  consistent  vs’ith  the  notation  introduced  in  .5).  In  these  terr.is,  a general 

algebraic  perturbation  Aa  c b(X,Y)  of  rank  j)  will  Ire  v.nitten  as 

n 

(3.0)  Aa  = ir.  ><  V.  , 

* 

whore  the  vectors  u.  e Y and  functionals  v.  c X , i “ l,2,...,n,  form  linearly 

1 i 

indei'cndent  .sets.  Tire  rcimjc  of  the  oper  ator  (3.8)  is  Y = .span{u,  ,u^ , . . . ,u  }.  In 
' n 1 2 n 

the  fiiritc-dimcMir.ional  case,  Y could  coirreide  with  Y , and  arbitrary  j^eiturba- 

n 

tions  of  linear  operators  could  be  written  in  the  form  (3.9). 

Algebraic  perturb.ations  of  vectors  arid  linear  operators  are  sometimes  referred 
to  as  finite  rank  modifications.  Thi.s  terminology  is  useful  if  a clear  distinction 
Ixrtwem  analytic  ;md  algebraic  methods  is  intended.  By  the  use  of  algebraic  pertur- 
bation theory,  one  worrld  expect  to  obtain  tire  perturbations  in  solutions  of  linear 
problcmis  in  the  ';nmc  form  as  the  perturb.ntions  in  the  data.  For  example,  one  would 
want  to  express  Ax  as  a linear  coml>i  n.ati  on  of  vectors  deter- 

mined, that  is.  Ax  c span{x.  ,x^, . . . ,x  ) - X , a finite-dimensional  subsp.ico  of  X. 

12  n n ^ 

Similarly,  expres.sions  of  the  form  (3.9)  for  Aa  and  AA  would  bo  sought.  In 
other  words,  algebraic  per tvirbat ions  in  the  data  of  linear  problems  are  oxixrctcd  to 
give  rise  to  finite  rank,  modi  fications  of  Hieir  solutions. 

In  contrast  to  analytic  portui b.ition  theory,  the  use  of  algebraic  methods  docs 
not  involve  restrictions  on  the  norms  of  the  perturbations  in  tlie  data.  However,  it 
Is  jvi.s.siblc  that  algel,>raic  pert urb.it i onr.  con  be  small  in  the  analytic  sense,  so  that 
eitlier  technique  could  bo  cmjdoyod.  Also,  as  i 1 lusti'at ed  in  the  next  section,  cer- 
tain I'J'oblems  lend  themselves  to  a coni!>i nat  ion  of  algebraic  and  analytic  nothovis. 
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4.  oi'orM PIT,  tho  riodholm J^lu'oi'Yj^  ^ theoretical  aiipl  ic.it ion  oT  I'crtnr- 

bation  nethpiln,  wliich  also  liar,  implications  for  numerical  computation,  is  the  oxten- 
r.ion  <'f  fl'o  tlieoi-j'  of  finite  linc.ir  alyebraic  systems  of  n equations  in  n un’inovv-ns 
to  certain  tyi'>es  of  linear  eque.ions  (1.1)  in  infinite-dimensional  r.j'accs.  An  exten- 
sion  of  tliis  ).iml  will  be  obtained  licrc  by  tbc  use  of  both  analytic  ,md  algebraic 
teebniques.  Kiist,  the  alternative  structure  (1.1a)  of  the  theory  of  equation  (1.1) 
will  be  given  an  explicit  formulation  for  the  class  of  operators  to  bo 

rK^n_rm  t ^I'li  4.1.  binear  operators  I'olonging  to  a class  G f-  L(X,Y)  aie  said  to 
have  a FrcdtinJm  theory  if  for  each  h cG  ^ either  (i)  the  hotrogcnocur.  e.71;. if  ion 
(4.1)  /vx  = 0 

has  the  unique  solution  x = 0,  in  which  case  the  inhomogeneous  equation  (1.1)  has  a 
unique  solution  x for  each  y c Y,  or  (ii)  equation  (4.1)  lias  nonzero  solutions, 
each  of  which  can  be  oxiircssed  as  ci  linear  conOiinat  ion  of  a finite  number  d 1 incarl 
independent  f.olutions  ' ^2 ' • • * ' e X , in  wliich  ease  the  trnnuponed  Ijon'o^jancour. 
eg u.'il  ion 


(4.2)  eA  = 0 

* 

likewise  has  d linearly  independent  solvit  ions  7.^  , , . . . , c Y , in  tcrr.v.  of 

whicli  all  its  nonzero  solutions  arc  expressible  ns  linear  combi  i nat  ions,  and  the  in- 
homogeneous. equation  (1.))  has  no  solutions  unless 

(4.3)  < z^,y>  = 0 , i = 1,2,. ..,d. 

If  (4.3)  is  satisfied  .and  x^  is  any  .solutioii  of  (1.1)  (soinotimcs  called  a p.irtj- 
cuJar  solution)  , then  the  general  solution  of  the  i nliomogcneous  equation  c<in  be 


written  as 
(4.4) 


d 

X ==  Xq  4 J a.  X.  , 
1=1 


with  arbitrary  scalars  O,  ,(t, , . . . , . 

12  d 

For  tJie  algolirnic  care  X = Y = R , real  n-diinensional  space,  the  class  £7  of 
linear  operators  v^’ith  Fredholm  tlieory  consi.st.s  of  all  nxn  real  matrices  A = (a^.), 
that  is,  <7  = b(R*',R*^),  and  tlie  alternatives  in  Definition  4.1  were  known  to  hold 
long  before  1903,  when  tJie  Norwegian  matJicmat ici .ui  Ivar  Fredholm  (G)  er.talil ished  tlie 
corrosiiondence  between  tlie  tlieorior.  of  finite  linear  algebraic  systems  and  linear 
integral  equations  of  the  form 

(4.6)  x(s)  - X /^K(s,t)  x(t)dt  = y(s) , 0 < 5 < 1, 

0 *.  •= 
giving  rise  to  tlie  present  name  for  tlie  tlieory. 

Definition  4.2.  A linear  ojierator  K c L(X,Y)  is  said  to  bo  comp.^cf:  if,  given 

any  C > 0 , tlierc  exist.*:  a positive  integer  n = n(c)  sucli  that 

(4.6)  K = 5 + F , 

vJieie  II  .‘ill  < r.  and  F is  of  finite  rank  n. 


-10- 


A compac'l.  opcralor  may  Oi'iii  he  recj.uileci  ns  n small  analytic  pcrLuibat  ion  of  an 
oix?iaLor  of  fiiiito  rai^k,  or  ar.  a finit  e iMiik  iiusli  f ication  of  an  operator  wliicli  is 
small  in  the  analytic  sense.  It  will  ho  showi.  that  the  riedholm  theojy  c.in  he  ex- 
tended to  oj>e)ators  which  can  he  expressed  as  the  sum  of  a linear  operator  havimj  a 
continuous  inverse  and  a compact  oj'orator.  That  is,  if  Q ^ L(X,Y)  denotes  t lie 
class  of  linear  operators  d such  that  J ^ f L(Y,X)  exists,  V C l,(x,Y)  the  class- 
of  compact  operators,  and  (2  =p  the  class  of  linear  cj-ei'cators  c>f  the  form 

(4.V)  A = d + K,  d c P , K c 

then  each  T\  c Q has  a Kredholm  theojy.  This  assertion  will  he  pioved  in  the  next 
st-ctio;i  by  combining  lesults  f lom  both  analytic  and  algehrciic  perturbation  theoi'^’. 

Fii St , it  will  he  shown  that  if  J c p , then  one  has  the  well  knowu  result  that 
d H c p for  I|Ad]j  sufficiently  small.  hater,  the  FraViOli;)  :iJ  toin;it  ivo  given 
in  Definition  4.1  will  he  established  for  operators  which  aie  the  sum  of  invert  il'>lo 
linear  oi'cuatois  and  linoiir  opcjators  of  finite  rank.  The  t.taten.ent  that  opcrelors 
of  the  form  (4.7)  have  a Pjedholm  thcoj-y  vjill  tlien  follow  from  Definit  : on  4.2. 

f>.  Konsi  ngul  ar lineaj^  c-qua'ions  and  opeiators.  In  this  section,  the  probl  env-  of 

solving  lineai  s.yritems  and  the-  inversion  of  lineaj’  operator;,  will  Ije  considered  for 
the  nonningular  case.  Here,  alternative  (l.la(i))  liolds,  and  t'ae  inverse  A ^ of 
the  operator  h exists. 

a.  Analytic  pertuiliat  ion  of  v.'el  1 -]~osed  pl'c'hj£ms_^ 

De  f i n i_t_i  ori  5.1^  A proljlcin  is  said  to  be  wcJ  J-po.sed  if  it  lias  a unigue  solu- 
tion wliich  dc}>cnds  continuously  on  tJie  data. 

As  a general  rule,  analytic  perturbation  methods  arc  only  successful  wlicn  ap- 
plied to  well-posed  pnohlons.  Tliis  can  icquire  tlic  imiositicn  of  additional  condi- 
tions on  the  data  to  in.sure  uniqueness  and  continuous  dependence  of  tlie  solutic'n,  at 
least  in  some  neighlxirlicKid  of  the  solution  of  the  reference  pioblcm.  For  the  line-or 
problems  considered  in  tliis  section  to  ho  wel  l-po:;cd , the  continuity  (and  hence 
boundedness)  of  A ^ is  jcqvii  red  in  addition  tc>  its  existence.  Consequently,  it 
will  be  assumed  that  A ^ c h(Y,X)  in  the  follov.’ing  discussion  of  the  application  of 
analytic  perturbation  tlieoi'y.  If  A maps  X onto  Y , tlien  it  is  well  known  W,at 
A ^ c h(Y,X)  if  and  only  if  m(A)  > 0 [2,  pp.  145-150).  honnoth  (IG,  p.  194)  has 
derived  t)ie  relationship 

(5.1)  m(A)M(A“')  = M(A)m(A“')  = 1 

between  tlio  vippcr  and  lower  bounds  of  a linear  operator  A witli  the  contimious  in- 
verse A Furthemioro,  (A  + Aa)  ^ exists  if  M(A7i)  < m(A) . Using  (5.1),  this 
result  may  be  stated  in  toims  of  consistent  nojms. 
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Thc-orc'W  fi. } . If  (1 


(5.2)  (A^AA) 


1 -1 

< ^ t.ijon  exist 53  mu}  is  <jivi'u  by 


-1 


I (-a“^Aa)"a 


n.  -1 


n=0 


I’roof:  Tlie  )iy)X>thcT.i  J-.  (luni  .Tnl  oor.  the  convei  fjcnco  of  tlio  Scur.nnn  so;  jo;; 

on  the  riyht  nick'  of  (Si.  2).  Denot  ing  thin  nci  icn  by  S , one  fincts  liy  tiiioot  iv.nnii'- 

ulaticjn  tliat  (AiAa)S  - I , the  identity  operator  in  Y , and  S(AtAA)  = I ; tionco, 

-1 

s = (a+Aa)  . (}i;d 

Althoucjli  the  Kenr.i.inn  series  expansion  (5.2)  in  useful  for  tlicorc;tic  al  puigv'se;. , it  i: 
likely  to  lx;  too  5;lowly  convergent  for  jjractical  c;o;nputati on . The  )>artial  r.i:mr. 


(5.3) 


= ) (-a“^Aa)’V'^ 


n~0 


of  Dig  Noumrinn  f.crios  (5.2)  may  bo  obtained  by  the  fiinple  itoiatioii 

(5.4)  Sq  - a"^,  5^  - (a'V\A)Aj__^,  k = 1,2,.. 

From  (5.2),  for  0 = ||  A“^AaH  , 

- „kH  1 

(5.5)  jl  (ajAa) 


k 


S '‘■'ll- 


In  order  to  find  a more  efficient  method,  the;  HoioUiiicj-Ix^nsc'D'i  algo;  J ( k’n  |)  7)  may 
be  adapted  to  tliis  puij>ose.  In  this  special,  case,  the  iteration  process  i .s 


(5.0) 


-1  -1  2'^-'^ 
Bq  = A , n^.  = II  H (-A  A/,)  ' 


k = 1,2, 


It  is  easy  to  s.how  by  mathematical  induction  that  B “ S ; hence,  from  (5.5), 

K ..K  .. 


2 -1 


(5.7) 


(aiAa) 


-1 


2*" 

< - 4 
= 1-0 


-1 


-1 


so  that  the  sequence  defined  l;y  (5.6)  converges  quadra ti cal  1 y to  (AjAa) 

The  only  cadditional  labor  required  over  tl»c  more  .nlo\%’ly  convcrcjcnt  abioritl.m  (5.4)  is 


-1  . 


the  rei>catcd  sejuaring  of  the  small  o]>eiator  -A  ^Aa  . 

Attention  will  now  be  devoted  to  the  estimation  of  tlie  perturbations  A.A  * and 
Ax  in  tlie  inverse  of  t)»o  perturbed  operator  and  the  solution  of  the  portuibed  linoai 
equation  (2.3),  respectively  114,  15,  16).  It  will  be  helpful  to  introduce  Uie  no- 
tion of  the  enneiitjon  m)iit)>or  of  a Ixsundod  linear  operator.  For  A c b(X,Y),  the 
exact  condition  nujrbor  K(A)  of  A is  defined  to  be 


(5.8) 


K(A) 


M(A) 

m(A) 


and  is  a measure  of  U>o  distortion  of  the  imago  in  Y of  the  unit  ball  in  X .as 
transfonned  by  the  oper.ator  A . If  A lias  a continuovis  inverse,  then  1C  (A) 
M(A)H(A  ^)  by  (5.1).  For  computational  ).'urpose.s,  it  may  bo  ox^x'dient  to  use 
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conr.i  Silent  norm!!  for  I.(X,Y)  and  l-tY.X),  nnd  Uie  ox  jin.it  o coiuUlion  iui;.i.<cr 

(5.0)  k(A)  - II  a||  • IIa'^II  , 

which  is  nn  sspjxir  bound  for  »C(A).  The  inrquali  tics  given  bcl(’'W  will  be  stated  in 
terms  of  consiis'.tent  norms  and  approximate  condition  miirbcrs,  but  remain  valid  if 
these  upper  bounds  are  replaced  by  tlieir  exact  values. 

First,  from  (5.2), 

CO 

(5.10)  Aa"^  - (a+Aa)"'  - a“^  ==  I (-a'^AaI^-v"^  , 

. , n=l 

and  thus , 


(5.11) 


II  to"’ II 


- IU'’f  II  AMI - 

■ 1 -II ''■’ll  • II  Ml 


Dividing  (5.11)  by  ||  A ^ ||  and  multiplyiiig  and  dividing 
side  by  |j  A j]  gives 


II  AaII 


on  tlic*  light  hand 


(5,12) 


II  II 


. . V I aaI! 

k(A) 

Miir" 


l-k(A) 


II  A 


which  ognesscs  tlie  relative  change  in  the  inverse  in  teim.s  of  tlie  relative  p>erturh/a- 
tion  of  the  reference  opc'rato)  and  its  (aj'proximat  c ) eor.dition  number.  A similar 
expression  v.’ill  now  be  obtninc-d  for  thc2  pc.rturbation  Ax  in  the  sc'lution  of  (2.3). 


Theorem  5.2.  If  |1  AaH  < , , then  the  perturbed  linear  ccpiat.ion  (2.3) 

||a-^|| 

has  a uniejue  solution  w = x -I  Ax  for  each  z - y + Ay,  and 


(5.13) 


J AxJl  ^ ^kJA) . JLAaJ|_^  l|  AyJ[ 

II >‘11  •i-k(A)!l^^lL  11^  II  llvlL 

II  A II 


provided,  of  course,  Uiat  y f 0. 

Proof:  I5y  Theorem  5.1,  the  liypothesis  guarantees  tliat  D - 

exists,  wliich  implies  t)ie  uniguc  solviability  of  (2.3)  for  each  z . 

(5.14)  (A  + Aa)  (x  + Ax)  = y + Ay  , 
one  obtains 

(5.15)  Ax  «=  AA“^y  + (AiAA)~^Ay  . 

As  y = Ax,  from  (5.10), 

90  , 

(5.1G)  AA~^y  = I (-a"^Aa)”x  , 

n*l 


(ahA-A)  ^ =■  a~^+Aa~ 

Writing  (2.3)  as 
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r.o  tJint 


(5.17) 


||M-‘y|l  < II . J1_*!>IL  . 

■ i-||a-‘|| -IIaaII  1-ma)  ||a|1 


Similarly,  from  (5.2)  and  tlio  fact  tltnt  ||  y 


-'tx  < A . K , 


(5.18)  II  (AHAA)"^Ayll  < — ...ILAjL’.llliJL  ,, 

" i-ll  a'^I! -II  aa|i  llyll 

JL^y  11  . II  ;i| 

. 1 AA  „ ,1  " • 

.l-k(A)-^---  II  y II 

II  A II 

Inequality  (5.13)  now  follows  directly  from  (5.15),  (5.17),  and  (5.18). 


b.  Alqc'braic-  j^rl  urbat  i on  of  non.si  nq'il  ar  linear  oguat  ions  and  ope  rat  ors. 

T)ie  siirjdest  tyj^c  of  alqebiaic  pci  I \ir);.ation  (2.3)  of  tlio  linear  ;;yslem  (1.1)  i: 
will)  AA  = 0 and  Ay  restrict  c'd  to  ))elong  to  «'i  finite-dimensional  .subspace  of 

Y.  Given  a basis  ^y^  ' y2 ' ' ‘ ‘ ' ^’n^  need  only  find  tlie  corrcsjiondi ng 

basis  vectors 

(5.19)  = A ^y^  , i - l,2,...,n. 


i - 1 , 2, . . . ,n. 


of  the  Eubsjiacc  C x wliicli  will  tlion  contain  all  jossiblc  pert  iirb.at  ions  Ax. 


Tlius,  given 

(5.20) 

it  follows  tliat 

(5.21) 


Ay  = «^y^  3 a^y^  t ...  + 


Ax  = o.x,  H a.,x  + ...  + o X 
11  2 2 n n 


In  actual  computation,  it  may  be  more  efficient  to  solve  the  n systems  Ax^  = >b  , 

i ■=  l,2,...,n,  for  the  basis  vectors  for  X , even  if  X is  finitc-diincnsional  (5, 

-1  " 

p.  77),  than  to  calculate  A 

To  introduce  tlie  study  of  the  effect  of  a finite-rank  modification  of  .an  opera- 
tor upon  its  inverse,  t)ie  case  of  rank  one  perturbation  will  be  considered  first,  as 

all  the  indicated  operations  can  be  displayed  e.xplici  ‘y.  For  AA  = u><V  witli 

* 

u £ y,  V c X nonzero,  Uie  solvability  of  the  perturbed  system  (2.3),  that  is 

(5.22)  (A  + u ><v)w  i.  , 

will  be  invcstig.atod  for  arbitrary  z . As  A ^ is  assumed  to  exist,  t)ic  equations 
Au  •=  u,  Az  =■  z can  be  solved  uniquely  for  u = A u,  z = A z,  respectively.  In 
tenns  of  tliose  solutions,  (5.22).iviy  be  written  as 

(5.23)  w £ - G<v,w>  . 


Tlio  key  to  Uio  !:olv.ihi  li  ty  of  (5.23),  ond  lienee  of  (5.?2),  is  Oie  detennin.it  ion  of 
the  iuiiiAier  f,  = < v,w  > . Fi'om  (5.23), 

(5. 24)  < v,v  > + < v,u  > <v,w  > < v,z  ^ 

Jf  the  drtciiDinaiit 

(5.25)  6 = 1 ^ < v,u  > = 1 + < vA  > 

does  not  vanisli,  t)ien  (5.24)  lias  t)ie  nniqnc  j.olntion 


(b.26) 


<y  _ < V A ^7.  > 

6 1 + <v  A ^ u > 


where  the  notation  (1.21)  has  been  used  in  (5.25)  and  (5.26).  Kul>stitnt ion  of  (5.26) 


into  (5.23)  yields 


(5.27) 


so  tliat 


(5.20) 


-1  -1  <vA 

w = A z - A u , 


( A- 


A ^11  > ^_vA  ^ 
l+<vA~^  u> 


^ ^ 1-1  ■ a“^u><vA~^ 

(A  + U ' < V ) - A - — — 

1 + < vA  u > 


provided  ^ / 0.  Hence,  the  inverse  of  a rank  one  luodi  fication  of  an  invertible  OJ^e; - 
ojierator,  if  it  exir.ts,  is  a rank,  one  nodification  of  the  inveiso  of  the  leforence 
operator.  17ie  synmet  ry  of  (5.20),  sorictimes  called  the  S}iO}ir,tn~y.orrJ:.o:i-Wood:ui'y 
lormuln  111,  jip.  123-124;  35,  46),  is  apjic'aliny. 

Using  (5.20),  the  solution  w = x t Ax  of  (5.22)  is 


(5.29) 


. A J »“1a  <V,X+A  Ay>  -1 

X + Ax  = X t A Ay  - -- — A VI  , 

1 + < vA  u > 


(5.30) 


«~1.  <v  ,x^A  y>  ^-1 

Ax  = A Ay  ^ ^ • 

1 + < vA  u > 


Tlius,  the  perturbation  Ax  is  a linear  conbi nation  of  A ^Ay  and  the  vector 

^ —1  , ^ * 
u = A u.  If  Ay  is  an  algeliraic  perturbation  of  t)ie  form  (5.20),  and  u is  inde- 
pendent of  t.lio  vectors  x^  A ^y.,  i = 1,2, ...,n,^  tlien  Ax  will  lie  in  the  (iiil.)- 
diinensional  svibspnco  “ span  {u,  x^^.x^,  . . • » of  X ; othcivisc  Ax  c = 

span  {Xj^  ,x^, . . . ,x^^)  . 

Deforo  going  tc>  the  general  case,  two  application:;  of  algebraic  ixirturbation 
theory  will  bo  given  vs’bich  involve  rank  one  modifications.  Tlic  first  is  to  the 
Fredholm  integral  equation  (4.5)  in  whicli  the  kernel  K(r,,t)  has  the  special  form 

f u(t)v(s),  0 < t < s < 1, 


(5.31) 


K(s,t)  *= 


(u(t 
u(: 


iOv(t), 


0 < s < t < 1 . 
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Tills  typo  t<f  Kernel  .nii-cr.  in  .ij>i>lirnl  ion;; ; for  example,  as  a Croon’s  function  iK'tor- 

ninod  by  a twu-iK>int  K'>nn(1aiy  value  jnobloM  I-t/!]-  Given  the  roprosontation 

for  K(s,t),  the  intoijrol  oijuation  nuy  bo  wrill.on  as 

(5.32)  x(s)  - X l.{s,t)  x(t);U  - X /^u(:;)v(t)x(t)clt  = y(c)  , 

vlicrc  ® ® 

(5.33)  L(s,t)  = u(t)v(:,)  - u(;;)v(l),  0 5 ^ ^ ^ ^ • 

Fquation  C..32)  is  of  the  form  (A  - Xu  ><v).\  = y,  wlicro  A = I - Xl  is  a linoar 

Voltorra  integral  operator  of  scoond  Kin'S  with  korncl  (5.33)  , and  u v is  a 

Frcoholni  integral  opoi'alor  of  first  Kind  cind  I'ank  oiic  iv^ith  V.t'XTicl  \i(s)\  (t)  . Iho  in- 

verse A ^ = (3  - Al)“^  of  tlie  VoHerra  operator  of  second  kind  exists  for  all  X 
130,  pp.  52-53),  and  thus  tlie  linear  VoUorra  i;itegial  equation 

(5.3;])  w(s)  - X h(s,l)  w(t)dt  - w(s) 

0 ‘ 

can  Jx;  sol  \'ed  for  aibitjaiy  w(s)  ; in  p.articular,  one  obtains  C(s)  = u(s)  for 

w(s)  ==  u(s),  and  w(n)  = y(s)  for  v.'(s)  = y(s).  Corrosjx.'ndi ng  to  (5.25),  if  tlie 

yrudhohn  ncicrir.i nant 

(5.35)  6-  1 - X<v,u>  = 1 - X /\’(t)u(t)dt 

doc'C  not  vanisli,  tlKH,  f row  (5.27),  ^ 

(5.30)  x(s)  = Y(s)  ^ V u(s)  f\(l)y(t)dt 


x(s)  = y(s)  ^ J u(s)  /\(l)y(t)dt 


is  the;  imique  solution  of  (5.32).  llenco,  the  ;;olution  of  the  l'rf;dholn  ir.ti'gral  c-qu-:;- 
tion  (4.5)  wiai  t lie  Kernel  (5.. 32)  c-an  lx  obtained  by  .solving  the  Volteua  integral 
equation  (5.34)  v.’ith  right-hand  sides;  v.’(s;)  = u(s)  and  \/(.':)  ==  y(s>),  follov-c-i.  by  th. 
calculation  of  the  inner  product  integral.s  in  (5.35)  and  (5.36). 

The  Siorond  application  to  be  con;;idci'cd  for  rank  one  modification  o'  a lino.ii 
ojieralor  is  to  backcajd  crior  analy.sisi  in  the  solution  ol  linear  equations.  Su}'poso 
tliat  one  attempts  to  solve  the  lineal'  equation  (1.1)  and  obtains,  instead  of  x , an 
approximate  solution  w sncli  that 
(5. 37)  A V - y •»  r , 

witli  nonzero  rcsichinl  r , Tlie  Jlalin-r.in.ach  theorem  I3S,  p.  106)  guarantees  the 
exist  ence  of  a linear  functional  w c X such  lliat  ||  w 1!  = 1 II !i  . 

Tlius,  w is  the  exact  solution  c>f  the  linear  eou.ation 


r ><w 


(5.38)  ( A - V 

IMI 

viith  perturbed  operator  and  desired  right-)iand  5;ido.  An  analytic  bound  for  t)ie 
perturbation  of  A is  thus  ’ 


(5.39) 


II  Mil  » JLe?;<“_lL . JLdL 
IMI  ll»ll 
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Rolvirninij  to  the  :.l  utly  of  (ji'iummI  .nlyeltraic  ) ortujhiU.ion:;,  m>t.e  that  the  I'ljiiiv- 
iilence  of  {5.7.2)  ami  the  r.iiifjlc  scalar  eijwition  cslahl  iiO^os  that  {5.22)  has  a 

Frciltiolrn  thc-ory,  bccaur.e  (5. 2-1)  docs.  In  tlie  case  6=0,  the  humacjcneou J rcination 
(A  ^ VI  V )k  0 is  satisfied  by  (and  only  by)  vectors  w = nCi  with  ct  aibitra; 
I'hc  inhomogeneous  equations  (5.22)  and  (5.2'1)  tlu'u  have  solutions  only  if 

(5.40)  < v,z>  = < vA'^z  > = <v,z>  = 0 , 
where  V =■  vA  ^ sati'ifios  the  I ) ajisposu'd  homogeneous  e(]uaVion 

(5.41)  v(A  + \»  ><  v)  - 0 . 

mieoreiii  5.3.  If  .5  ^ b(X,Y)  denotes  the  class  cjf  all  invertible  linear  opeics- 
tors,  and  a ^ l,(X,y)  tlie  class  of  all  linear  opeiators  of  finite  rank,  then  all 
linear  operatojs  belonging  to  the  class  It  have  a Fredholm  theory. 

Proof:  If  H t (2  = If  , then  theie  is  an  ivertible  linear  ovierator  A c *5 

for  which  h can  be  written  ns 


(5.42) 


1J  = A1  ) u.Xv.  , 
3=1  ' ' 


where  u.  c Y,  v.  c X , j = 1,2,.. .,tt,  are  linearly  independent  .sets  C'f  veclois 

and  functionals,  respect  ively.  I'quation  (2.3)  in  this,  case  is  ecjtn  valent  to 

n 


(5.43) 


w = z - 


): 

3 = 1 


u . <v . ,w 
3 3 


where  z = A ^ z , u ^ = A j = 1,2,... ,n.  Ai'plying  the  functionals 

to(5.43)  in  turn  gives  the  equivalent-  finite  linear  algebraic  sy.Uem  of  ccruations 

n 

(5.44)  C.  ■»  )'  = C.  , i = l,2,...,n 


3=1 


13  3 


for  C = < V , ,w  > , where  r; . = < v . , z > and  a,.  = <v.,u.>,  i,i  = 1,2, ...,n. 

1 J 11  ij  1 3 • 

As  the  Fredliolni  alternative  apj^lics  to  (5.44),  it  fc>llows  that  operatois  of  the  for:. 


(5.42)  have  a Fredholm  theory.  t'KD 

In  the  nonsingular  case,  an  expre:;sion  can  be  obtained  for  H 
rank  modi  f i c«i  Lion  of  A Let 

(5.45) 


-1 


as  a finite 


M = (6.  . 4 0..) 

13  13 

debite  the  in-’trix  of  coefficients  of  tbc'  linear  system  (5.44),  where  6^^  is  the 

Kronecker  delta;  6.  . = 0 if  i 7^  j t 6..  = 1.  As  Oic  determinajit 
13  11 

as.sumcd  to  bo  nonzero,  the  inverse  of  M may  be  written 


of  M is 


M 


-1 


i ‘^i3^  ' 


n 


(5.4G) 
and  t)ius 

(5.47)  C.  < V ,w>  = ~ i P.  .C.  = T i 

j=j  3 « 13  3 

1 n 1,2,. ..,n.  Using  (5.43)  and  t)io  fact  that  < vp,S*.>  = < v^A  ^zl>  =-  < ^ 


0.  r v.A~^,  i 1,2,. ..,n,  one  obV.'vinn  tlic  uulvition  w of  (2.3)  in  t)>ia  c.tsc  ar. 
3 3 


(5.40) 


= (a  -V  \ ) a^u.>B..<v.a  )s'-* 

<5  • , • , 1 >3  3 

1=^1  3~1 


By  talcing  appropriate  linear  combinations  u ,\i  ,...,vi  of  u ,u  ,...,n  and  v ,v,, 

JL  4C  ^ JL  * 

of  v^,v^,...,v  (for  example,  by  an  lJJ-(1ccom:\')sit  ion  of  M (S,  pj>.  27- 
32)),  (5.40)  may  bo  piut  in  the  fonn 


(6.49) 
from  wliirli 

(5.50) 


w=(a^-"  y A^u.  Xv.A^lz, 

^ 3-1  ’ 5 


n -1  - n 

(5,50)  ( ^ + I u.  ><  V.  ) = a“  - ^ y A-  u ><  V.  a“  , 

. j=l  3 3 3 ^ 

wliicli  is  analogous  to  (5.20). 


Anotlicr  way  to  find  the  inverse  of  the  perturbed  operator  (53.42)  is  tlie  nieitiod 
of  r.iiccnsr,.i\’c  r,ink  one  modi  f ic\i(  ions^ , which  does  not  roguire  obtaining  M ^ c.splic 
itly.  Set 


(5.51) 

and  then  the  algoritlim 


(5.52) 


Bq  = A . a'-^  , 


1,  4 

u > < 

V , 

)c-3 

, k 

k ' 

u >< 

R-1 

k-1 

k 

*^k-l 

1 + 

< V,  b' 

k 1 

^1;  \-.l 


I 

j=l  ^ 3 


);  = l,2,...,n  will  give  P ^ = U ^ if  none  of  the  intermediato  dclcrwinantr; 

(5.53)  6^  = 1 + < ^ ^ = 1*2 n , 

vani  r.h. 

3t  -sliould  be  noted  again  t)iat  it  is  not  nece.ssarj’  to  obtain  A ^ to  solve  llie 
equation  (2.3)  for 

n 

(5.54)  w = 2 - ) C . « . » 

j=  1 ^ ^ 

as  given  by  (5.43),  t-Tliat  is  required  is  to  solve  equation  (1.1)  for  tlie  nH  1 right - 
liand  sides  y = z,  ‘ ' "n  ^ . . . ,u^^,  calculate  the  coefficients 

of  the  system  (5.44)  of  n equations  for  the  n unknowns  ' ^2' ‘ ‘ ‘ ' ^n'  this 

system,  and  t)i(-n  form  t;)ic  linear  combination  (5.54). 

An  Imixartant  application  of  t)io  above  tcc)inique  of  algebraic  pertui b.ition  is  to 
the  numerical  solution  of  partial  dif fcrer.tial  equations  by  what  is  called  tlie  ca;\r- 
citnner  nuitris  method  |36,  42).  Tlio  basic  problem  is  to  solve,  for  example,  t.lio 
Voianon  or  HelmJioltz  equation  on  a region  f),  with  information  given  on  its  botmdary 
(see  Piguro  5.1).  Hjc  use  of  f initc-di  f fercnce  methods  will  lead  to  a linear 
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Figure:  ?i.l 


i 


algcbitiic  tiyr.trm  B w = 7,  which  meiy  be  very  laborious  to  .solve.  On  U10  obhor  h.uid, 
rapid  iind  effective  method;;  may  be  nNsailable  for  the  algc-braic  ;;ystem  TlX  = y corres- 
ponding to  the  name  finite-difference  approx  i mat  ion  to  the  pioblcm  ]v>;..ed.  on  ai:  en- 
closing rectangle  R witli  bcnindroy  3r.  By  legarding  the  algebraic  system  olh  -.ined 
for  il  as  a finite  rank  jierturbat  ion  of  the  easily  solved  sy.-  tem  ^lri5.ing  fror.-.  th.e 

approximate  problem  on  R , a considerable  jc’duction  in  effort  may  be  I'ossibl  e . Tvj  . 

2 

cally,  if  the  order  of  the  systems  (1.1)  and  (2.3)  is  about  n , t.lien  the  rank,  of  Us 
perturlrat  j ons  h7\  and  Ay  wil  l be  apJ^roximately  n . 

1'hc  Fredliolm  theory  will  now  be  sliowii  to  apply  to  operators  wlrich  are  t)ie  sum 
of  a continuously  invertible  ojrerator  and  a compact  operator. 

Tlrcorem  S.'l.  Operators  A )rclongirrg  to  the  clas;;  defined  by  (-1.7)  have  a 

Fredholm  theory. 

Proof:  Choose  C < 1/|1  J ^ 1|  . Accorditrg  to  Defirritron  4.2,  Uie  comi'iact  Oi^era- 

iio  K may  be  written  as 


(5.55) 

wltcrc  ri  = n(e) 


n 

K = S + I 
j=l 

is  fiiritc.  llrus, 


u.>  < 
3 


n 

(S.Df.)  A = J + S + \ u.  ><  V.  , 

and  Theorem  5.1  guarantees  the  existence  of  the  irrvcisc  operator  (JtS)  £ L(Y,X). 
It  follovT.  from  Theorem  5.3  tlrat  A has  a Fredholm  llreory.  pED 

Tlreorem  5.4  provides  a basis  for  the  ''kenrol  splittiirg"  metlrod  due  to  Erlrard 
Schmidt  I4,  p.  155)  for  j^rwing  tlie  Fredholm  Altcrn.rtive  Theorem  (6)  for  the  linear 
integral  equation  (4.5).  Supj-oso  Urat  K(s,t)  is  con(;inuau5,  or  at  least  can  be 
apinoxinated  sufficiently  well  by  a kernel  of  finite  rairk  so  tlrat  one  c.an  write 
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n 

(r..S7)  K(s,t)  S(K,0  + y u.(s)v.(1)  , 

5=1  ^ ^ 1 

wlicrc  S(<-.,t)  ir.  Llio  kc'inol  of  a linear  integral  operator  S with  ||  S [j  < in 

IM 

D)e  ajii'J opri ate  norm.  Then,  the  linear  iiilogral  operator  I - XK  in  (*1.5)  ha*;  the 
form 

n 

(5,r.n)  I - Xk  = I - Xs  - X y ij.  ><  V.  , 

■ -1  ' 

vhcro  (1  - XS)  = T(X)  exij;ts  by  Theorem  5.1.  Apj>lying  thir.  operator  to  the  oqvia- 
tion  (3  - XK)x  - y,  tl;e  integral  equation  (4.5)  is  seen  to  be  ctuiivalent  to  t)ie 
linear  ecuiation 

n 

(5.59)  (1  - X y T(X)u.  ><  v.)x  = T(X)y, 

j=l  ^ ^ 

and  thus  I - Xj:  has  a FrcdJiolm  t)ieory  by  Tlicorem  5.3.  T)ii.s  approach  regards  1-XK 

as  an  algt-biair  pc*i  turbat ion  of  tlit-  invertible  op’crator  I-XS. 

Oil  t)ie  ot)iej  )iand,  ‘;vi}q'or.c  tliat 

n -y  n 

(5.f>0)  (1  - X y u.  ><  v.)~  = 1 + T y V.-  = 

j-1  ^ ^ j-1  ^ ^ 

exists,  v.-liere  t)ie  notation  (5.50)  has  licen  used.  Then,  I - Xk  is  an  analytic  per- 
tuihalion  of  an  invtntilde  operator,  and  (4.5)  is  equvvalc'nt  to  t);e  equation 

(5.01)  (1  - X'/(X).5)x  - 7.(X)y  . 

From  Tlieoicm  5.1,  if  (I  - Xk)  ^ exists  and  ))  Xsjj  < 1/1](T-  Xlt)  |j,  tltcn  F-iX) 
exist.*;,  so  all  ruf  f iei  C')it  1 y good  finite  ran);  approximations  (5.57)  to  K(s,t)  will 

lead  to  a solvable  pertuibed  equation 

n 

(5.02)  (I  - X y u.  ><  v.)w  = y 

3=1  ^ 3 

vhicl)  is  equivalent  to  a finite  linear  algeljraic  sy.*;tom  of  tlic*  form  (5.44).  Conver.s- 

ly,  if  Die  inver.se*  opoator  X(X)  exists  and  ||  Xz(X)S  [j  < 1,  t)icn  it  follows  fiom 

t);c  same  tlicorem  tliat  (I  - Xk)  ^ exists.  If  u ,vi  , ...,u  and  v ,v  , ...,v  arc 

1.  2 n 12  n 

clioscn  so  tliat  all  the  inner  produetr.  required  can  ho  calculated  explicitly,  tlioii 
tliis  gives  a melliod  for  concluding  tlio  existence  and  uniqueness  of  Die  solution  of 
Die  integral  equation  (4.5)  on  tlic  bar.is  of  a finite  set  of  algebraic  computat  ions , 
ns  well  as  a tocliniquo  to  obtain  apjuoximate  solutions.  An  error  analysis  for  (5.02) 
rvay  )rc  carried  out  by  the*  analytic  metliods  of  f'5n  witli  AA  = -XS,  Ay  = 0.  A similar 
approach  can  ho  u.sed  on  (5.59)  witli  T(X)  replaced  by 

(6.03)  Tj_  (X)  = I + Xs  -t  X^S“  + ...  + X^S^  . 

Sotting  z = T (X)y,  t)ic  i'Or\  orhod  equation 

^ n 

(5.64)  (I  - X y T (X)»i  X v.)w  z 

j-1  J ^ 
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mny  )jo  iin.Tlyroil  by  Uic  i;;iinc  iocbiiicivio , with 

n 


.nnd 

(S.CG) 

As  lh'(A)ll  < va- 
cs.67) 
one  hcio 


Aa 


X ^ (Xs) 
3=1 


T(X)VJ.  ><  V. 


AT(X)y  = -(Xs) 

X?]]  ) , and  for 
n 

Xf  = X 

3=1 


k+l 


T(X)y  . 


u.  >< 


(5.6R) 
wi  t h 
(5.6')) 


II  M II  < 


l-ll  Xs|| 


- Xr 


II  AT(X)y 


1-lllsl! 


\\>y\\  5 l>‘!  );  IN 

3=1 


froin  (6.67). 

AnoDior  .inalylic  approach  to  the  ai^pioximate  ;-.cilution  of  ('5.S)  v.-'iich  a]::c>  yield-, 
error  Kavindn  is  to  .solve  (6.61)  by  iteration,  as  ||  Xz(X)sl|  < 1 129). 

6.  'Jlie  <;inqul<ir  cav.e  and  qeneivil  i zed  _i  jiycyir^r^  Attention  v.'ill  now  be  der'ot  od  to 
linear  j >i  obi  which  are  ill-posed  bcfcause  the  linear  o;'erator  involved  does  n.ot 
have  a lonnded  inverse.  As  tlic  .solution:.,  if  any,  of  ill-)-'o;;ed  prv'bleiTrs  do  not  do-  . 
pond  r>n  the  datii  in  a eontimioun  fashion,  it  inicjht  be  expected  in  thi:;  sit’.mticn  tli.it 
analytic  j>er  t urbat  i on  methods  will  be.  of  little  utility,  or  can  be  applied  only  unde: 
vci  y restrictive  cc>:idit  ions.  For  exciniplc,  there  is  an  inherent  limitation  ns  to  how 
v.-oll  an  ojx?ra1or  n c b(X,y)  without  a continuous  inverse  can  be  aj-'proximated  by  ,in 
operatcjr  A belonqing  to  the  class  p 61  L(X,V)  of  opeie.lors  with  contine.ous  in- 
verses A ^ 6-  b(Y.X).  From  Tlieorcm  5.1, 

(6.1)  11  B - a||  = II  AaII  > ' 


.-1 


(6.2) 
r,o  that 
(6.3) 


11  a“M1 


,-li 


otlieja.’iso,  the  assumption  th<at  B p would  be  contradicted.  Also,  from  (6.1), 

i 1 

I II  b-aII  !!  AaII 

and  the  appro.viimte  condition  number 

> J'lll-.., 

„ „ “ II  toll  ■ II  toll 

grow  without  limit  as  H Aa|1  •>  0.  Clearly,  computational  difficulties  can  be  o.\pcc- 
pcclcd  in  the  calculation  of  A ^ or  in  t)ie  solution  of  the  linear  equation  (1.1)  if 
A is  very  close  in  tlic  analytic  sense  to  an  operator  B which  does  not  have  a con- 
timious  inverse. 
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Tlieovcm  G . K If  {a^)  C p is  ;my  sciiuciuri-  of  linear  oj’eratoi  :;  lurli  Ih.il 
Jim  ||a  -11  11  = 0,  then  H f*  5 if  anil  only  if  (0.2)  lioldr.  (or  eacli  A A , n - 

11  e 

n 

I'joof:  If  M ^ Q , tlien  it.  liar.  already  been  rhovn  tlint.  (0.2)  lioldc  for  c.ieb  A^  . 

*1\3  r)k)W  the  converse,  r.«i'>ix'>r.e  that  H f p , and  choose  n suf  f i c.i  onLly  laryo  .-.o  Ih,  ■ 

II  M II  =11  A -H  II  < .1/2||  11  ^11  . It  the.-n  follow.s  f jom  (0.2)  that 


(0.^) 


II  A, 


-111  . I!  R ^Jl  _ _ . 1 

' 1 -IKJI -Ih'-’ll 


a cont  1 adict i on  of  (0.2)  wliicli  proves  the  theorem.  OI'D 

An  evident  dravbacV;  of  analytic  perturbation  theory’  is  that,  in  general,  r.o 
conclusions  can  be  dravai  from  the  existence  of  A ^ c L(V,>:)  alxnit  the  invert  ibilif. 
or  noninvcrtihility  of  any  cipelator  B for  which  inecjuality  (6.1)  holds.  The  alge- 
braic theory,  on  the  other  liand,  states  that  if  B is  tlie  finite  rani:  modi  f i c.it  ion 
(r>.^2)  of  an  invertible  linear  oj'-erator  A c , then  B ^ exists  if  and  only  if 


(O.h) 


6 = dci.  1 v . ^u  . > ) ^ 0 

13  1 3 


Of  c:ou)se,  one  would  still  expect  cns.jnit.at i onal  difficulty  if  B is  nearly  sircalai 
especially  if  the  innei'  i-rodncts  = < v^A  im  > , i , j ■-  l,2,...,n,  c'.->n  o:.2y  be 

cnlcul  ated  a]jj)roxi -.lat  el  y . 

The  al<jfl))aie  apjiro.ich  also  }'iovides  i n for:r.;i t i on  in  the  singular  case.  h-.s  ;x>s- 
ing  (hat  6 = 0,  coiujjdri  1 )ie  transpo.sed  homogeneous  eguation 


(0.0) 


t ( A t y u . ><  V . ) = 0 


i=l 


for  1 c X . Using  the  technigvie  of  5db,  t)iif.  is  eguivalcnt  to  the  finite  linear 
algc-braic  system 


(0.7) 


T.  4 y I .ft.  . = 0, 

-*  ^ ^ A 1 ' 


i=l 


1 13 


3 = 1,?, 


.n. 


for  T = < t,u  3>  . The  system  of  equations  (0.7)  is  t)ic  tranr.‘.v>sed  )iorr;ogcneous 

j 3 

system  corrosi'onding  to  (6. ')')).  If  6 = 0,  t)icn  (0.7)  )ms  d line.irly  independent 
solut ions 
(0.0) 

and,  eorresi^onding  to  tliese,  equation  (0.0)  also  )ias  d linearly  independent  solu- 
tions 

.(k) 


,(k)  _ ,(k)  ^ (k)  (k).  . _ , , , 

T ^1  ' ^ P **"'*^n  ^ * k—  l,2,.*.,d. 


(0.9) 


7 T . V . A 

i^l  " " 


1 

i=l  ^ ^ 


k « 1, d.  Likewiro,  tho  hor>o9oncou£^  syr.ton 

n 

(6.10)  4 y ti. jC.  ■=  0,  i 

j=i  ’’  •* 


1,2,. « • #n, 
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)tns  <3  lini'.irly  i ndcix'iiilont  r-o]  \it  ions 

(6.11)  k - 1.2 d, 

from  v.'liic')i  .uc  obtaincvl  t )ic  cojror.jx>i)d3  iitj  liiic.irly  ind('pc'jidcnt  :;ol\ilions 

(k)  V r(k).-l  ^ V ,(k). 


(6.12) 


w 


V ~ V t'^’C 


j = l 


j = l 


k ==  l,2,...,d,  of  t)ic  )>or.i09cnc'oxu;  fq\Mt.ion 

n 


(6.1  3) 


(A  + I 

j '3 


u , 


' < V . ) w “ 0 . 


-1  -1  -IT 

(<v, A 7>,<v  A z>,...,<\'  A 

12  II 


Rcpror.c'iU  imj  tlic  right. -li.nnd  rodl’^.  of  tlio  r-ystem  (!>.'1'})  ap  t lie-  vector 

(6.  I'D  f,  = 

it  is  seen  i)vj-.'.odiatrly  t liat  the  condit  ionn  for  the  solvability  of  1 ho  finite*  i :ih: 
genrons  syst.cm  (5.4^)  and  the  fujiiivalrnt  inhomogoncou.s  equal  i<m  (2.3)  fo'.  the*  ease 
’6  0 arc 

(6.K.) 


< l<  T . V.,2>=<t  ,2>-  0, 


k = l,2,...,d;  that  is,  z bo  oi  t hcxjonal  to  all  solxitions  of  the  h.or.o.gop.oo'js 

equation  (G.b).  If  (6. IS)  is  !iati:fiid,  then  the  yenoial  r-clution  of  (2.3)  r.ay  b. 
virittc'n  as 


(6.16)  w = w t ) («  , 

k-1 

vhoj'o  w is  so;;iO  j\ij  l.ic-ul.ij'  :.r>}ui  ion  of  (2.3),  and  the  cor.p]  c;,:..i2t,i  i y wotCJs 

fkl 

(6.17)  w - k{(!j  ,(i^,  . . . ,(\j^)  = ) 

satisfy  the  homogeneous  cqu.ation  (6.13)  for  arbitrary  ‘ '^k  ‘ 

Usually,  in  actiuil  com)nitat  ional  .*;olvU.ion  of  linear  equations,  the  distinction 
between  tlie  singular  and  nonsingular  car-c-s  is  not  as  clear-cut  ns  in  the  alternative 
(1.1a) or  the  Krcdholm  theory.  In  practice,  an  objec:tive  or  subjective  standard  is 
set  for  what,  constitutes  an  "acce*ptablo"  (approximate)  solution,  and  one  of  the  fol- 
lowing situatic'ns  is  obs(»rvod: 

^ (i)  An  acceptal))  i*  solution  is  obtained, 

or 

(ii)  either  no  r.olution  at  all  is  found,  or  the  comi'utcd 
solution  is  uriacceptablo . 

In  tlie  cor,ij>v(  citJoitalJ  ij  s 1 yy  1 7 a r case  (G.lGii),  the  method  used  to  solve  (1.1)  or 
invert  A may  break  down  because  A docs  not  have  a boundovd  inverse,  or  is  analyti- 
cally close  to  an  operator  D /f  p . On  the  other  hand,  the  algorithm  cmi'iloyed  may 
actually  be  trying  to  solve  the  system  (S.^-l)  with  6 = 0 and  without  (6.15)  holding 
to  the  desired  degree  of  accuracy.  This  will  ))C  called  an  .iJgobrnir  cat  ast  ropbp  of 
tyfx?  J . In  the  second  situatioii  clc.^eril'ccl  in  (G.lGii),  the  acceptable  particular 


(G.18)  < 
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solution  w way  ront  niiiin.xtcd  by  a I'-oinjil  cmriit  ary  voctor  to  Ibo  c-xlcnd  that 

the  icsul  t ing  r.olvition  ii;  vm.xcccpt  This  a.?<7oi>2V/Jc'  CJt.isi  roj’hi'  of  ti:to  ]J  can 

occur  in  the  nuwerical  solution  of  di  fferential  . cqxxations  by  the  use  of  ajp)  it  i ng 

difference  equations.  Poj'  cxaniixle,  the  diffciencc  equation 

(6.19)  3u  + Ru  - 3u  =0 

ntl  n n-1 

witli  the  initial  condition:; 

(C.,20)  ”0  - !■  “l  “ i • 

lias  the  Ixninded  solutions 

(6.21)  u (^)"  , n = 0,1  ,2,  . . . , 

n 3 

vliicli  may  be  tlic  ones  consiclored  to  be  accej.'tablo . However,  a slight  j.'ort  urlvit  ion  o* 

(6.20) ,  such  as  rouncliny  to  eight  decimal  places, 

(6.22)  w^  = 1,  w^  = 0.33333333 

gives  the  cor  respond  inn  solvitions  w of  3w  , + 8w  - 3w  , - 0 as 
^ n n3l  n n-1 

(6.23)  w = (O.9999D9090)  {’-)”  t (0. 000000001 ) (-3)  , 

n j 

n = 1,2,...,  and  Die  second  tenn  on  l)ic  riylit-hand  side  of  (6.23)  will  event  x:.';l  1 y 
v.’rcnV.  liavoc  with  the  accuracy  of  t)io  approxi i;iat  ion  of  u^  by  . 

As  indicated  in  5lb,  if  the  operator  A is  singular,  tlicn  a general  5 ;;ed  inverr 
A^  of  A having  certain  useful  jiroporties  may  be  sounlit,  for  ex.Tn',-''l  c , to  gi\c 

solution  of  (1.1)  in  the  form  (1.4)  if  (1.1)  is  con.si  .stent . As  (1.5)  i nd>  cat  t , the, 

+ . . . 

vector  X = A y v.'ill  be  a particular  solution  of  (1.1)  for  any  inner  inverse  ..  o: 

A.  An  algebraic  perturbation  met)iod  m.ay  be  used  to  obtain  inner  inverses  of  .singula: 

operators  wliich  have  a Predliolm  theory,  under  the  technical  assur.iption  that  tlic-  spaia 

* * 

Y is  reflexive,  that  is,  Y = Y (30,  p.l92).  In  tliis  case,  if 

(6.24)  U = {Uj  u^}  C Y 

is  a set  of  linearly  independent  functional.s  on  Y , then  the  Hahn-I'anacli  theorem 
guarantees  tlie  existence  of  a set  of  d linearly  independent  voctorr.  in  Y to  v.liich 
the  Gram-r.climidt  ortlionorinalir.ation  process  (30,  p.  116)  moiy  be  applied,  if  neces- 
sary, to  obtain  t))e  set 

(6.25)  U = ‘ ^ 

for  w1)ic)i 

* * 

(6.26)  < ^ ^ ~ *ij  ' ' l,2,...,d  , 

v/hcrc  6 . - again  denotes  the  Kronecker  dclt.a.  Similarly,  given  a sot  of  linearly 
13 

independent  vectors 

(6.27)  V »=  C X, 

n cot  of  functionals 

* * « * * 

(6.20)  V “ . . . ,v^}  C X 
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e^xistr.  mu'Ii  tli.it 
(6.29) 


< V.,V.  > = f> . . I 
13  13 

whctlior  X in  rcflcxivo  or  r.ot. 


i , j = 1 , 2 , . . . , c) , 


Thcor£iii^  6_. 
(6.30) 


.‘iui'iono  th.it  A c h(X,y)  liiiG  .1  rn.-c)ho)in  tlioory,  .incl 


u A •-  Av  - 0 

* f * * * -i  - *■  I 

if  .ind  011I3’  if  u c r.i\in  (vi,  . . . ,n^)  C y ,md  v c i>.'>  n { , v _ 


J 


1 


. V } C X , 1 

d 


the  dt'f('ct  d of  A is  ixisitive.  Then,  for  c li  .ind  c V , ):  ],2,...,d, 

vliere  U .ind  V <ire  defined  liy  t6 . 24)  - (C.  29)  , the  oi'Cr.itoi' 

(6.31)  B 1=  A - ),  It  ><  V. 


h=l 


); 


is  invertible,  and 

(6.32)  . Air^A  =-  A 

.so  that  A^  = n ^ is  an  innto  inverse  of  A . 

rz'oof:  To  .show  t)iat  H is  invcz-fible,  consider  the  )io;i.ocjonco’a.s  o.iiiation  B: 
0,  wliich  is  equivalent  to 


(6.33) 


Az  " ) i’l  < ^ 

k=  1 ^ ^ 


hii  tlii.s  c-qu.it  ion  i.s  solv.iblc  if  .ind  only  if  the  riqht-haiid  side  is  01  t b.ecjon.il  t; 

* * * 

«,  .u.,,  . . . ,u  J bc'c.inse  A h.i.s  <1  rrcdholin  theory,  it  follows  fjoi.i  (6.26)  th.it 

* 


< Vj  .Z  > = 0 , 1;  - 1,2,  . . . ,d  , 


(6.34) 

and  thus  Az  = 0.  Tnis  ino.inr,  that  z is  of  the  forr.i  z = 6.v  ^ •••  + ^ 

11  2 2 d c 

where:  the  coefficient:,  a are  yiven  liy  (6.34),  and  hence  z = 0 is  tlie  viniiiue 

^ . ...  -1 
5.olution  of  the  hnnioyoncous  equation  Bz  ■■  0,  v.’)iic)i  ir.ijilios  t)ie  cxistcrrcc  of  B 

To  jnove  (6.32),  note  that  fjoai  (6.29),  (6.30),  <md  (6.31), 


(6.36) 

lienco 

(6.36) 
and 

(6.37) 


Bv.  = 

1 


d 

'V 


);=1 


< V , V.  > - -n. , 
):  1 1 


i ” l,2,,,.,d  , 


1:  = 1,2, ...,d, 


-1. 


A ^ b“^(B  1 I \ = I - 


k=l 


k=l 


and  (6.32)  follows  directly'  f ror.i  (6.30) 


QED 


(6.38) 


Jnstcad  of  (6.36),  one  could  also  use  the  relationsliips 

* -.-1  * 


“U. 


k ” 1,2, ...,d, 


-1 


to  cst.ilrl  j i;)i  (6.32).  T)io  opc-r.itoi'  B ~ A obt.iin.-d  frczi  (6.31)  is  c.illcd  J/erwit 

pscvdo.ii)\’ors(‘  of  A |31,  j>p.  166-168;  12),  wliicli  qoe:;  back  to  1912. 

By  t))0  same  jeasoninq  a.s  al»ove,  any  oj'cintor  of  Die  form 

+ ^ * -1 
(6.39)  a'  = (A  - [ iij.  > (Ij.  < Vj^) 

k>=l 


-25- 


lor  Pj^»p2' 


,P,  nucli  Uiat  / 0 will  ho  on  inner  invoryo  of  A 

o 1 2 d 


How- 
ever, i'»s  l.her.c  oi'orator:;  me  invertible,  l)icy  cannot  natisfy  condition  (2)  of  5lb 
which  characterizes  outer  inverse,';;  con.sequeiitl  y , Dio  const  i uct  ion  (G.HO),  while  vise- 
fvjl  for  sonic  piui^oses,  only  yivos  a partial  solviti.on  to  the  problem  of  finding  genor- 
nlizod  invei.sos. 

Another  matter  of  conijiutation.il  iinj''oi‘t  ance  relates  to  Die  calculation  of  g»'ner- 
nlizcd  im’orsos  of  perturbations  of  oper.itojs  with  l.nown  geiuializcd  inveir.es.  f-uii- 
jxise,  for  example,  that  one  h;is  an  efficient  technicpie  to  obl.iin  the  Kioi  I'-reni  ore 
generalized  inverse  A^  of  A [27],  and  Dic-n  would  like  to  use  the  lesult  to  c'bt.iin 

the  generalized  inverses  of  peiturbod  o}''<.‘iators  H = A h Aa  with  less  effort  th.in 

•f-  . 1'  i' 

calculating  B ah  initio  , or  error  bounds  for  tlie  ;i]iproxii;.at  ion  of  B by  A 

As  A is  not  a continuous  function  of  A in  ycr.firal , it  would  be  ex]jectcd  th.it 

analytic  jierturbation  methods  apply  only  under  )c:itri  cti  ve  conditions,  as  even  for 

II  Aa|1  arbitrarily  small,  one  of  the  algebraic  cat  actroph.es  that  the  rank  of  B is 

greater  or  let.s  Dian  Die  rank  of  A could  occur.  Itost  ajijili  cati  ons  of  analytic  }ici- 

turbation  theory  to  the  above  jnobleias  a.ie  carried  out  under  as.sumptions  that  ensure 

rank(li)  =-  ra/)k(A),  oi  tliat  the  change  in  lank  is  known  123,  j'p.  333-3M],  Algebiaic 

perturbation  m.at)iods,  on  the  otliei’  hand,  are  not  neccs.'i.iri  ly  subject  to  th.is  kind  of 

limitation.  For  rank  one  modi  f i c.it  ions  of  A , C.  D.  Kvycr  ^ Jr.  119;  23,  pj-i  3M- 

3S2)  bar.  obtained  formulas  of  Die  type 

(G.^10) 

for  all  six  josr.ible  cases,  where  G dc]ionds  on  and  the  data.  More  general 

finite-rank  modifications  (5. '12)  of  A can  then  lie  liandled  liy  the  method  of  .succe.s- 

sive  rank  one  modifications  corresponding  to  (5.  f>l ) - ( 5 . f>2)  . Tliis  latter  algorithm 

was  originated  by  Greville  19)  for  the  recursive  calculation  of  the  Moore -Fcnror.e 

generalized  inverse  of  a matrix.  Forrruil.a  (C.-IO)  reduces  to  (f>.2B)  in  tlie  speci.nl 

. 1'  -1 

case  that  A is  invertible,  as  for  any  generalized  inverse  of  A , I\  - for 

all  A c J . Iliis  enggests  Dio  compnt.nt  ional  strategy  of  using  a method  for  gener- 
alized invejsion  on  an  operator  which  is  svispected  of  being  singulai'  or  nearly  singu- 
lar. If  the  operator  or  t.lio  I'citurbad  operator  actually  invol\ed  in  the  calculation 
is  nonci  ngular,  then  this-  techn.ique  will  yield  its  inverse,  wliercas  a st.iaightfoiward 
inversion  mctliod  miglit  fail. 

Another  api’roach  to  ill-}>oscd  problems  is  to  nj'jiroxinatc  them  by  a pe’rturl'od 
prxiblcm  wliich  is  well  conditioned.  An  e.x.implc  is  Die  tcclinique  of  rcguJ.irirat 
due  to  A.  N.  Tilionov  (39,  40],  whicli  bar;  close  connections  witli  the  subject  of  gener- 
alized inverses  (22).  If  the  ojxrrator  A in  (1.1)  doe.s  not  liave  a bonn.led  inverse. 
Dim  the  smallest  j>oit\irbation  Ay  in  tlic  data  can  cause  an  onormons  eliangc  A.n  in 


•V  i 

( A 4 u ><  v)  A 4 G 
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■the  jiolution  of  the  j>oitiubi’d  jijoblem  (2.3)  ns  fC'injMicd  to  the  i>o]ution  of  the  refer- 
ence ]>robJcm.  A tyi'icnl  aitiintion  in  whicli  j>robl  einu  of  type  arise  in  applica- 

tions is  that  X and  Y are  Hilbert  s]iaccr.,  and  A K is  a conj'act  opoiator.  Tin 
prototyiK-  of  the  resulting  equation 

(6.41)  Kx  ^ y I h c /\  I 

is  the  linear  Fredliolin  integral  equation  of  the  first  kind  , 

(6.42)  . K(s,t).x(t)dt  = y(s),  0 < ^ ^ • 

As  I'orturbati  ons  in  (6.42)  in  actual  practice  are  inovit.iL>]  e,  duo  to  errors  of  neas- 
urement,  discietication,  and  ccr.iputation , direct  numerical  solution  of  (6.42)  by 
standard  techniques  that  worh  well  foi  the  integral  equation  (4.5)  of  second  i.ind  ai< 
rarely  successful.  Tlie  same  observation  may  be  made  for  (6.41)  as  compared  to 

(6.43)  (al  - K)>:  = y 

for  Ct  f 0.  In  ojdcr  to  find  an  iicceptctljle  approximate  solution  of  the  pertinl>ed 
version  of  (6.41),  the  method  of  regularization  consists  of  finding  on  element 
w(q)  c X which  minimizes  the  functional 

(6.44)  f(w;a)  = II  Kv.’  - z||  ^ ||  w||  ^ . 

Tlius,  (6.44)  represents  a trade-off  betwi-en  the  fidelity  with  which  the  perturbed 

equation  Kw  = z is  satisfied,  and  the  si.ze  of  the  norm  of  the  corresponding  rolu- 

2 

tion.  The  parameter  n (or  sometimes  a ) in  (6.44)  is  called  the  rciju2jrirnt:on 
parameter  . The  crucial  problem  in  this  field  is  the  determination  of  the  optimi] 
regularization  parameter,  for  which  the  value  of  f(w,-a)  is  minimum,  or  at  least  a 
method  for  obtainijig  good  oiq^roximations  to  the  optimal  value.  A significant  recent 
advance  in  this  urea  is  the  application  by  Grace  V.’ahba  (41)  of  the  method  of  weighted 
cross-validation  to  the  case  that  the  j'erturbation  is  due  to  discretization  of  the 
data  with  random  errors  of  the  type  known  as  "white  noise". 

7.  Tne  eioenvaliie-eigenvector  probl  cm.  As  stated  in  §lc,  this  problem  is  to  find 
eigenvalues  A and  right  ciucnvcctors  x / 0 satisfying  (1.9),  where  A c L(X,X), 

X a Hilbert  si>acc.  It  follows  that  one  is  interested  in  tb,e  values  of  X for  wliich 
the  linear  oj>erator 

(7.1)  T(X)  = A - Xl 

is  singular,  and  one  may  also  want  to  find  the  left  oiqcnvectois  y / 0 of  A 
corresponding  to  the  eigenvalue  X which  satisfy  the  homogeneous  equation 

(7.2)  y(A  - Xl)  = 0 . 

The  additional  assunq>tion  will  be  made  that  the  values  of  X considered  are  re- 
stricted to  those  for  which  T(X)  has  a Fredholm  theory.  Hiis  condition  does  not 
exclude  any  X in  the  f initc-dinonsional  algebraic  case;  however,  for  Fj cdholm  iiitc- 
gral  oi^erator-s  of  the  first  kind  or  compact  cj>orators  in  general,  it  is  custom.ary 
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to  formulaic  tlio  pj<jcnvnluo-ci(iciivcctox'  juobl  I'ln  in  Ici'ms  of  tlic  recij>roc.il  eiin’iivalu 
J/^/  ‘IS  Die  oj'orator 

(7.3)  S(li)  = I - »IK,  K f V , 

vill  li.ivo  a I'lrcltiolin  tliooiy  for  all  t.calarr.  li  c A by  Tlioorcm  Ii.3.  Tbir.  is  ciiviivn- 
Icnt  to  cxclxuling  X = 0 froia  roiisidernt ion  in  (7.1)  if  A is  compact. 

In  order  to  contcnplatc  the  niii'l  icat  ion  of  anal^’tic  j\'i  tin  b.at  i on  motV.o.ls  to  D.o 
cigonv.t  1 iie-ci yciivcct or  inobleni,  it  i.s  cs'cnlial  to  dctt  inine  conditions  under  v’lich 
this  problem  is  vol  l-posed , ns  tlie  op'ornt-o!  T(X)  v.'ill  he  sinnul.nj'  if  X is  an  eioe 
value.  One  way  to  do  tliif.  is  to  c«'nvert  ('cju.d  ion  (1.9)  and  tlic  norm.il  i r.at  ion  co;idi- 
tion  (1.10)  into  the  nr>nlinc.ir  system 

Ax  - Xx 

f 

(7./!)  l’(q) 


=■  0 


1 


x,x 


1. 

2 2 

in  the  jiroducl  .•'p.ice  f>  - X x A of  vecto's  a = (x,X)*,  x f X,  X c A . f'Uj.'i'Osc 

r 

1 --I'-'j' 


Diat  q,  = (x,,X,) 


is  a solutix'ii  of  (7.'”i);  that  is 


is  an  eigenvalue  of  A 


and  is  a con  csiiondi  ng  noi  m.-il  i red  c' i c;c  avert  r>i  . Tlu-n,  the  inijilic'it.  function 

theorem  [10)  guarantees  ec'Ut  i nuou'-  dejendanof  fif  t)ie  solution  of  (V.d)  on  the  c.ita  i 
the  linear  operator  h' (q^  ) »'.  h(C.',C?)  h.is  a 1 nundod  ji.verr.e,  x.’l'.cre  P'  (q)  is  I lie  Free):-. 


(Jot  iviit  ive 
(7.5) 


P'  (q)  - 


A - X: 


<x 


-X  > 


0 


of  the  operator  P at  q 1^0,  pp.  97-100). 
Jnoct  general  [1),  has  the  advantage  that  if 


The  formulation  (7.4),  while  not  the 

* 

A is  1/e'rm.f  f ian  (A  = A [30,  jqj.  324- 


327]),  then  so  is  P'  (q)  . The  following  tlK'orcm  gives  an  explicit  foi  rivil  at  ion  of  th 

inverse  operator  [P'(q^)l  ^ in  this  case  if  the  defect  of  T(X)  is  eqvial  Vo  one, 

that  is,  if  all  solutions  x of  the  )ior.ir>gc'nc;ous  conation  T(X^)x  = 0 are  scalar 

multiples  of  the  normalized  eigenvector  x^ , making  use  of  the  fact  th.it  tlie  j'ight 

and  left  eigenvectors  of  an  Jleimilian  operator  can  be  identified. 

T 

is  llormitian,  q^^  = (x^,Aj)  satisfies  (7.4),  and  the 


Theorem  7.1 


If 


defect  of  T().^)  is  equal  to  one,  then 
^ ' “I 


n. 


(7.6) 


IP’ (q^)l 


-1 


" ’'l 


- <: 


where 

(7.7) 


-1 


(A  - X^l 


>< 


xj 


-1 


is  Die  Ilui-witz  pEoudoinverse  of  A ~ X^^I. 
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Troof ; It  follows  by  illrcct  cal  c;oJ  .ition  and  llic  vise  of  (G.3G)  and  (0.3R)  that 


tlip  identity  operator  in  Q - X >•'  A . PEb 

By  the  use  of  Theorem  G.2,  formula  (7.G)  c.in  bo  extended  iiivnediat  ely  to  th.e  non- 
Hemiitian  case  yjT(X^)  = = 0,  jrovided  the  defect  of  I'CX^)  remains  canal 

to  one  II,  53].  Under  these  circumstances,  results  are  available  by  the  r.ethcv's  of 
analytic  jH.'itxirhation  theory  similar  to  those  for  nonsinyular  linear  equations  (1.1) 

II,  5!.]. 

Kor  the  finite-dimensional  case,  per  turlrat  i on  methc>ds  and  ej  ror  analysis  for 
the  alycbraic  eigenvalue  }U'oblem  have  been  j->recented  in  gi-eat  detail  in  th.e  compre- 
hensive vojk  by  d.  H.  V.’ilkinson  ['1-1,  pp.  G2-1C8].  Just  one  of  these  result;;  will  l;c 

cited  lieic,  which  fits  into  the  framework  of  algc-luaic  )rei  I ur  l.'ation  tlreory.  Pupi^ose 

T 

that  w is  a unit  vector,  and  p = (w,ji)  is  an  ;ip:rroxiinat  e solutioii  of  (7..1),  so 
that 

(7.9)  (A  - liT)w  = r , 

with  residual  vector  r . I’rom  equation  (5.38),  it  follows  tliat 

(7.10)  (A  - r ><  w*  - \ll)w  = 0 , 

so  tliat  w is  an  exact  eigenvector  of  the  perturbed  operator: 

(7.11)  D --=  A - r ><  w* 

corresponding  to  the  eigenvalue  p I^-l,  f>p.  170-171].  The  pcrturlred  operator  B i .s 
simply  a rank  one  modification  of  the  reference  operator  A . 

Another  application  of  algebraic  I'crturbaticn  theory  to  the  eigenvalue-eigen- 
vector problem  lias  been  given  by  W.  Stenger'  |37]  to  find  inotjualitios  between  cigen- 
valuc.s  of  irerturbed  and  reference  integral  operators. 

8.  binenr  programming.  The  solution  of  linear  prograr, ruing  jiroblems  as  formulated 
in  5ld  is  one  of  the  primary  tools  for  decision  making  in  government  and  commerce  at 
the  xrresent  time  18].  The  nuiiiror  of  variables  involved  is  typically  large,  and  a lot 
of  comjiutor  time  is  expended  for  this  purpose.  Thus,  an  a)'i>l icatioii  of  perturbation 
thoorj’  which  would  increase  efficiency  could  result  in  substantial  savings.  Once 
again,  Uic  fact  that  the  solutions  do  not  depend  continuously  on  the  dat.a  in  general 
limits  the  applicability  of  analytic  iier  lurb.at  ion  techniques.  A necessary  and 
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foiuUt  ion  (ox  contiiiviinis  dipoixilonoc  of  tlt<^  s.olution  of  tlio  px  i mnl  aiiJ  dvial 
liixo.ix  jTO>|i  .mmii  IK)  ]>i  f'liK  m'j  in  a xioii)t>l>0)  Iioo<l  of  .'.olvalile  x'ofox  i-ncc  j’l  obloms  h.'ir.  Ix't’ii 
given  lofoixtly  by  S.  M.  Kobin'on  5^(»n.lic:;  of  wbat  in  cailoci  j\ii\in:ot tie  ]>ro- 

gr.iiixttni}  give  roiuHtion:.  vmdex'  x.-hich  tl.o  i.olxition  c'f  tbo  lofc^xcnci^  pxoblt'ni  I'cmnins 
iincb.ingod  vtndcx  jei  t iiibat  ion  of  tbo  data  I ('• , )>p.  1-1 '1-1  r>'1 ) . On  the  subject  of  i!ixor 
csl  ir.uit  X ixn , I'.  V.’olfi-  l-IS]  b.ir.  ooiit  i i 1 nt  rd  n xaclbod  for  rxror  analyr-ir,  and  contiol  in 
tlic  i-olntion  of  liniMi  jkkji  araiint]  jn  obi  i;.v. . 

Altlioii,j!i  I li  wiji;-  in  tb.-  objo<  t ivx-  fiiiic-tion  (I.!-!)  arc  not  usually  difficult  to 
deal  with,  )•'  I t ui  1 at  loii!  in  the  xin'txainl;-  (l.Hi),  nr,  would  result,  for  cxaniplo,  by 
tb*-  ini  lodu^  t i*>n  of  .i  n<  w t<-*  biK'b-gy  in  an  industxy,  nay  roguixe  the  complete  x c- 
staiting  c>f  tin-  :.e>luti*'n  irctbod  in.ed.  Con;  ecxient  1 y , the  following  problem  may  be  of 
jn  .let  ical  i nt  ei  est  . 

riobl*n  (t.l.  (liven  the  solution  x of  ( 1 . 1 <5 ) - ( 1 . 1 5)  and  tliC  associated  infox- 

nation,  :a>tli  as  the  choice  of  })ivots  in  the  siinjilc-x  algoiitbn  (45),  find  an  efficient 
ni-tbud  fox  x.olving 

((I. I)  intnimi/.c  f (w)  :=  < d,w  > + V| 

subject  to 

( It . i’ ) B w ^ z , w ^ 0 , 

v.bexc  .ill  )>ei  I urb.,1  ions  in  the  xefexence  data  arc  of  finite  xanb  which  is  sm.all  com- 
jvixed  to  the  size  of  the  i cftxcnci-  pxolilein. 

9.  probl  r::is . Although  this  survey  has  been  concexned  mainly  with  linear 

i'xcblen;.,  it  should  be  lai.-ntioncd  that  pextuxbation  methods  are  vxidely  applied  to  the 
solution  of  ixonl  inear  operator  equations 

(9.1)  P(x)  = 0 , 

whcnc  B maps  X into  Y , and  also  fixed  point:  problems  in  X of  the  form 

(9.2)  X = H(x)  . 

(It  is  evident  that  (9.2)  is  a sj-ecial  case  of  (9.1);  conversely,  there  are  many  ways 
to  convert  (9.1)  into  an  equivalent  fixed  j'oint  problem.) 

TlieEC  jxroblcms  are  well-posed  in  the  nci ghboi'hood  of  a *;olution  if,  for  ex- 

ample, H i.s  continuous  and  contractive  [30,  Chapter  2),  or,  more  restrictively , if 
P is  di  f fer*.-ixti able  and 

(9.3)  I'p  = IP'  (Xq))"^  c L(Y,X). 

Depending  on  the  s.mooDiness  of  P , iix  this  case  one  can  base  analytic  perturbation 
techniques  on  the  ixnplicit  function  theorem  110),  Newton's  metliod  and  its  vari.aixts, 
Taylor  scries  expansions,  inversion  of  po'.\-ev  series,  and  so  on  (30,  Chapter  4). 

Thex'.e  methods  .are  .all  c'sscnti.ally  derived  fiom  the  corresixondi ng  ideas  of  clemont.ary 
RC.al.ar  c.ilciilur.. 
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Rcci'iitly,  W.  J-liciiiloldt  )ias  «jivc'n  gcnoi  ;ili  :’.nt  iona  of  the  coiulilioii  (r>.f<) 

and  (5.9)  for  non]  incar  ci'oi-ators  for  w)iic-)i  (9.3)  liolds,  .mcl  a cor>  ('?  jondiiio  fji  noi  - 
nliznlion  of  the  I'ertviiliat  ion  foimnl.i  (5.13)  for  error  cr.linialjon  |33). 

Myobraic  I'crl  nrbat  i on  motliods  for  nonlinear  operator  eyiiationr.  a)o  ler.r.  well 
invcDtiyated.  A nonliiicar  oj'cratr>r  Y with  ranye  belonyiny  to  the  f init  c-dijrin-.iona'! 
Bpaco 

(9.-1)  • Y •=  siKin  {y  , y , ...,y  } 

n I / n 

will  bo  of  the  foim 

n 

(9.5)  F(-)  = 5;  y.  > f.(.)  , 

3-1  ^ ^ 

where  f .(•)  i f .(*),...,  f (•)  are  (ycnerally  nonlinear)  f nnctional  n on  X . T'ne  i>or- 
1 n 

turbed  operator  equation 

(9.6)  Q(x)  = 0 , 

where  Q = P - P,  is  equivalent  to  the  equation 

n 

(9.7)  p(x)  - 
where 

(9.8)  = fj(>=)  . 3 ^ 1/2 ,ri  . 

Suppose,  and  thifi  is  the  hj<j  a::r,\}r;pt  ion , that  the  equation  P(>‘.)  y in  rol\’r>ble  for 
y C Y^,  that  is,  an  operator  G in  Iniown  v.liicli  gives 

(9.9)  X - G((:j,^2 

if  P(x)=  y is  of  the  fono  (0.7).  Thcii,  aj'plying  ^q'^2'’‘*'^n  (9.9) 

yields  the  nonlinear  system 

(9.10)  C.  = h.  (f;, , i=l,2,...,n, 

where  h,  = f,G,  )i^  -■  f G,...,h  = f G , which  is  a finite-dinoioiional  fi>:cd-point 

112  2 n n 

problem  in  A of  the  foirm  (9.2).  On  the  basis  of  the  addition;)]  ;issu,'^pi  ion  that 

(9.10)  is  solvable,  the  substitution  of  its  r.olutioiis  C-,  » C- # - • . » C into  (9.9)  pro- 

12  n 

vidcs  a solution  x of  the  nonlinear  operator  equation  (9.6).  As  .an  example  of  this 
approach,  the  Jlr.r.morst  cin  intc^rftl  equation  with  V.ernel  (5.31) 

0 

integral  equation 
0 

Cu(s)  , 


x(s)  - / K(s,t)<}i(t,x(t))dt  - 

0 

is  a rank  one  modification  of  the  nonlinear  Voltcrra 

x(s)  - /■’  L(s,  t)<^(t,x(t)  )dt  = 
0 

Thus,  if  one  can  solve 

x(s)  - L(s,t)<>(t,x(t)  )dt  « 

0 


(9.11) 


(9.12) 


with  kernel  (5.33) 

(9.13) 
where 

(9.14) 


t » /'  v(t)(^(t,x(t))dt  . 

0 


3=1 


S^3 
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Toi  x(r.)  <j(t;;0,  t)icn  fio:»  (0 . 1 <5 ) , ■ t he*  ;.y;.V(Mn  (9.)0)  is;  CHiviiv.iiont:  to  t )u>  .•u.-.d.i 


fixctl  joint  jiroblcin 

(o.iro 


C - )i(U  v(l)<.'  (t  ,M(t  ;U)‘lt  , 


which  is  0)10  nonlinonr  cqxiation  in  one  \niknov;n  i?n,  ?if>)  . 

Allho\ujh  quite  a hit  is  known  about  nonlinear  systcr.is  (0.10)  in  f ini  t e-rti ; ''n- 

sion.il  sjMces  (20),  tlic  tlieory  .inci  j'>rartico  of  tlieii'  solution  is  fai  f i o::i  tlu-  )iiubl' 

cleve)  oj'csi  Ic'clinoloyy  available  foi  finite  linear  systeir.:  (fi.'l'l).  Tliero  i alst'  t lie 

ever-jii  esent  big  afsuf.uit  ion.  Kven  though  (0.0)  is.  not  obtainable  I's;'"!  i c i 1 1 y , the 

foim  of  the  jiroblciTi  (9.7)  sugi;c;its  iteration:  Solve  (9.7)  for  (jiven  | \ i.  \ , 

. (0)  12 

(,  , substitute  into  (9.10)  to  rVitain 

(9.1  G)  ^ ( -'j  * ^2  # * • * f 'I  1 “ , 

ami  so  on.  In  Die  case  that  (9.C>)  is  a bonnclai  y- va  1 ue  jirobleia  (or  ,i  ncsil  incar  ilifte 
ential  equat  ion,  thi  r- i s eallf-cl  ".shooting"  (1-3,  Chaj'lei  2,  also[C'.l).  Of  eou;:-.e,  th.ir 
i teration  i.iay  not  converge , ami  r;o;:ie  olhei  met  ho.l  loj-  solving  (9.C)  maybe  more  .ij'i'roo!  i,  ' • 

Tliis  section  will  also  cbnoliKle  v.’ith  an  iiuj'ortanl  jiroblem,  as  much  rcu  e v.(U  k 
needs  to  be  done. 

lb  obi  cm  1_^  bc'j  dii  ferent  ial'lc  1'  , develo))  exJ.'.tenr:e  tb.cs'y  ai.d  fir, cl  effec- 
tive techniques  for  co:rputiiig  solutions  >;^  of  Die  nonlinear  oj'e’.itor  eaviation  (‘'.i 
in  the  case-  that  P'  (>;^)  doe;;  not  havo  a bonnded  invo;:;e. 
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